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nd I am a de- 

veloper. I 

guess. Of 

sorts. I have 
written code, espe- 
cially for articles. Most 
of the time it was 
“pedagogical” code, in 
that I wrote it to teach something, such 
as how to control external hardware 
using a web version of Scratch, or how 
easy it is to write an apps for a given mo- 
bile OS. But, even stuff designed for 
teaching has real-world applications. 
Thus, the Snap! expansion that I created 
to be able to access the Raspberry Pi’s 
GPIOs actually works, as does the imple- 
mentation of Conway’s Game of Life for 
FirefoxOS [1] - which even got into the 
store. 

I am also a documenter. That’s actually 
my day job. Apart from editing for 
Ubuntu User, I write for its sister publica- 
tions, Linux Magazine and Raspberry Pi 
Geek, blog professionally for OCS-Mag 
[2] (OCS stands for Open Content and 
Software, by the way), and shadow-write 
for Free Software-dealing companies and 
organizations. I also get into heated writ- 
ten arguments on the virtues of FLOSS 
on the Internet, but I’m not sure if that 
counts. 

Tm a beta tester - a.k.a. a sucker for 
bleeding-edge versions of funky Open 


INFO 
[1] My measly Git repo: https:/ 
github.com/pbrown66/snap-RPi 


[2] OCS-Mag: http:/www.ocsmag. 
com/ 


Dear Ubuntu User Reader, 


Source apps. As soon as a new version of 
Blender, Inkscape, Synfig, LibreOffice, or 
whatever gimmicky software catches my 
attention is released, I’m all over it. If it’s 
not in my distro’s repos, I’ll go download 
a package from the project’s site. If there 
is no package, I’ll grab the source files 
from the Git repository and compile it 
myself. Unsurprisingly, experimental 
software often doesn’t work as expected. 
When I hit a hitch, I’ll check around, see 
if anybody else has the same problem, 
maybe even drop into a chat room and 
talk to the developer. I might file a bug 
report. I suppose that also puts me on 
the quality control team. 

And, I do marketing. I talk about Free 
Software whenever I can, in public at 
conferences or on the radio; in private at 
parties (yes, I know: I’m a blast at social 
gatherings - I don’t quite get why I’m 
not invited to more). I wax lyrical on the 
technical, social, and personal benefits, 
and explain to anybody who wants to 
hear about how Free Software is the last 
line of defense that protects our waning 
digital rights, and will help save the 
world to boot. It so happens that I also 
believe these things, but how I reach 
these conclusions is a matter for another 
article. 

Because, this is not “Meet the Editor” 
day. The point I am trying to make is not 
about me (although I am the nearest and 
clearest example I have at hand right 
now). It is about how somebody like me 
- somebody who is not an engineer by 
any stretch of the mind, who has a Di- 
ploma as a Teacher of English as a For- 
eign Language for Adults as his highest 
qualification on his résumé, who never 
stepped onto a college campus as a stu- 
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dent - can still contribute something 
back to the Free Software community. 

It is about how in Free and Libre Soft- 
ware, because of its status of a heritage 
for the whole of humanity, most posts 
are open and there are not half enough 
people to fill them. Sure, developers! de- 
velopers! developers! are the stars of the 
show and are featured on the stages of 
most FLOSS-related events, But, as in 
any other industry, the whole Free Soft- 
ware “company” can’t sustain itself with 
its stars alone. The beauty of the whole 
thing is that the customers are also the 
employees, as well as the stockholders, 
so we are (or should be) vested in the 
progress of the technology and the ad- 
vancement of the apps and underlying 
operating systems and firmware. 

It is about the fact that, although the 
lines between vendor and customer are 
clearly defined within the proprietary 
software world, they are so blurry in Free 
Software as to be non-existent. You 
should not look upon Free Software as 
something handed just to you to con- 
sume, but as something you can and 
should make your own - as in your own 
business, your own product. And, you 
should contribute to make it better. After 
all, Free Software thrives on collaborative 
and complementary skills. 

Why not add yours to the mix? 


av 


Paul C. Brown, 
Editor in Chief 
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Back to Basics with the Bash Terminal 

The Linux terminal is ubiquitous in the Linux world. Although 
created in the 1970s, the earliest days of modern computing, 
it has not outlived its usefulness. 
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respond to output from 
other command-line 
tools. 


The Sed Stream Editor 


With sed, you can edit text data without an interactive user 
interface, using pipes or input redirection. Sed lets you 
execute extensive editing commands on a single line. 
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The Illustrated Terminal: In this issue learn the 
basic building blocks of the Linux shell, the instructions 
and commands that will start you on your road to 
command-line gurudom. 


On THE DVD 


Ubuntu 15.04 — Vivid Vervet 
Get the hottest new version of Ubuntu 


e Gnome Terminal 3.14 
e Ubuntu Make developer tools 


Loops in Shell Scripts 


Programming loops allow one-time or multiple execution of 
instructions. The condition for the loop can exist both outside 
and inside it. Learn advanced loop usage with our in-depth 
tutorial. 


Small Shell Tools for Text Editing 


With the jack-of-all-trades sed, you can certainly master any 
kind of text manipulation, but the result is often complex 
and hard-to-remember syntax. The helpers presented in this 
article replace or enhance sed for many smaller text editing 
tasks. 


Awk as Tool and Scripting Language 

In Linux, the need for text processing programs is a big 
one: System configuration, system management, and data 
exchange all use text-based files. With Awk, you have a 
powerful tool at your fingertips for text editing and targeted 
modification. 
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Know How 


lh Fonts, Page Color, and the Magic Number h) Creating Informative Graphs with Plotutils 


Learn how to create a document with a pleasing combination The plotutils package promises quick help to visualize 
of fonts, color, and spacing. numerical data in a variety of output formats. 


DESKTOP 


h] Managing IMAP Accounts with Trojitá ] | Realistic Drawing with MyPaint 


Gone are the days when we read email solely sitting at our Using MyPaint and a graphics tablet, you can create or trace 
computers. To read messages on the move, we now have drawings with the feel of real pens and brushes. All the 
IMAP, which has completely displaced POP. Trojitá makes Necessary tools are included. 


IMAP easy, even with accounts with big folders. : f 
lf Manage RSS Feeds with QuiteRSS 


Screenshots with Shutter When the news comes at you like a flood, you need a tool to 
All major desktop environments provide programs for channel the current. RSS readers like QuiteRSS can help you 
taking screenshots; however, their features usually pale in sort through the news. 
comparison with those of Shutter. 


Il Rodent Data Manager 


The Rodent data manager can do more than just move files. 
However, it's not always easy or intuitive to use. i e il Toolbox for Mass Storage 
# Linux provides several 
tools for maintaining mass 
storage. Gnome Disks 
combines the most important 
functions into one interface 


Discovery GUIDE 


If you are new to Ubuntu, these tutorials will help you get started. 


84 Installing Ubuntu 15,04 90 Package Management 
Ubuntu 15.04 offers nearly no changes to Ubuntu's Software Center lets you install 
the installation process. We'll walk you just about anything, including free software, 
through upgrading or installing the latest purchased apps, and games. Learn how to 
release. make the most of it. 

88 Network and Updates 93 Multimedia 
With NetworkManager, you can access You can configure your Ubuntu system 
the Internet during the Ubuntu installation to support movies, music, and Internet 
process. The first step is to download telephony. We present some favorite 
updates to make your system more secure. multimedia apps. 
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PlusServer stands for excellence and professional hosting: 


= More than 40,000 servers worldwide 
= More than 20,000 customers 

m More than 20 years experience 

= More than 30 different product types 
= More than you would expect! 


We offer the highest standard of hosting to you, so 
that you can provide your customers with nothing 
short of the best products on the market. 

Our expert development, technical support, sales 
and customer service teams are at your disposal 
around the clock giving you the ability to be on top 
of the competition. 


Find out more: 
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Ubuntu fans have been waiting a long time for this: Canonical, through its partner Bq, has released 
its first official Ubuntu phone worldwide. The Android and iOS alternative is convincing in tests, 


although it does show room for improvement. 


The first worldwide official Ubuntu phone 


UBUNTU CALLING 


BY JACOB DAWID 


oes the smartphone market, 

which is saturated with An- 

droid, iOS, and Windows 

phones, as well as various ex- 
otic options, really need another com- 
petitor in the form of the new Ubuntu 
phone? Many users are asking this 
question. 

The issue with Canonical’s new off- 
spring is about quality and not quan- 
tity - even if the Linux distributor it- 
self aims at wanting to address “each 
user.” 


A quick glance at the underlying 
Ubuntu phone [1] technology elicits 
curiosity: Canonical ensures that ap- 
plications derive from QML [2], a 
powerful declarative language for 
creating user interfaces from the Qt 
framework. 

QML is easily combinable with 
C++, and other language bindings 
exist - creating perfect conditions to 
attract not only many, but also very 
passionate developers who appreciate 
the technical advantages. But, how do 
users view the new 
Ubuntu phone? 


UBUNTU ON THE PHONE 
The first official Ubuntu 
phone [3] comes from 
Spanish manufacturer Bq 
and is derived from its 
Android-equipped 
Aquaris E4.5 model [4]. 

Experimentally in- 
clined owners of the An- 
droid version report that 
the Android system of 
the conventional E4.5 
can be replaced with 
Ubuntu. However, the 
Ubuntu version of the 
device is missing the 
touch buttons at the bot- 
tom of the screen, along 
with some software func- 
tions such as a radio ap- 
plication. 


UBUNTU USER + WWW.UBUNTU-USER.COM 


The E4.5 has an A7 quad core pro- 
cessor from MediaTek with up to 
1.3GHz clock rate. The 1GB RAM and 
a display resolution of 960x540 pixels 
should be sufficient. 

The Aquaris E4.5 has two SIM cards 
and an SD card slot that supports 
SDHC cards with up to 32GB memory. 
The internal memory is just short of 
8GB, of which 4GB are available for 
images and music. The camera shoots 
pictures with 8 Megapixel resolution 
- quality that is impressive at such a 
low price. 

The Aquaris E4.5 Ubuntu Edition 
seems rather light in weight at about 
123 grams with its generous 2150mAh 
battery. As with many other devices, 
the battery is fully integrated into the 
phone; therefore, the housing makes 
a stable impression, even if the plas- 
tic does not. The device’s design defi- 
nitely falls into the “simple” category 
- being somewhat reminiscent of the 
iPhone 4. 

The display, which is surrounded 
by a wide frame, wins points for its 
brightness and for the scratch- and 
impact-resistant Dragontrail glass that 
feels pleasantly smooth under your 
fingers. The plastic frame fits well 
over the top of the glass edge to pro- 
tect the screen. 

In the packaging next to the phone, 
you'll find a USB loading device, a 
substantial USB cable, the manual, 
and a small tool for opening the SIM 
and SD card slots. Bq dispenses with 
the obligatory poor-quality head- 
phones that other manufacturers 
often include. 

With a retail price of about 170 
euros, the Aquaris E4.5 Ubuntu Edi- 
tion is positioned somewhere in the 
lower midrange. The price-perfor- 
mance ratio on pure technical terms 
rivals that of competitors with other 
operating systems in the price range. 


E4.5 11 AIL 

Of particular interest to Linux users 
is the silicon heart of the device: the 
Ubuntu Touch operating system. 
Even a year ago, technically savvy 
users could install Ubuntu Touch on 
their smartphones. For a develop- 
ment device, Canonical provided the 
LG Nexus 4, which came very close 
to the actual Ubuntu phone’s perfor- 
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Figure 1: Quick settings and messages come 
down from the top of the screen. 


mance. The avid developer commu- 
nity unfortunately ported Ubuntu 
phone to a series of other smart- 
phones [5], thus the quality of imple- 
mentation varied greatly from model 
to model. 

The Ubuntu phone, unlike Android, 
iOS, or other smartphone systems, is 
totally devoid of a keyboard, requir- 
ing you to memorize several gestures 
(Table 1). Depending on which side 
of the screen you swipe, you can 


Figure 2: A quick swipe from left to right brings 
the starter bar into the foreground. 


open the application menu, drag in 
notifications and quick settings, or 
switch among running apps. Whether 
you swipe from the left or from the 
right makes a difference, as does 
whether you make short or long 
swipes or drag across the middle of 
the screen. 

One function especially stood out. 
Over a docking station, the Ubuntu 
mobile phone can also be used with 
the familiar desktop interface [6], or 


As with Android, a swipe from the upper screen edge 
down pulls down the status bar for making quick and 

convenient settings (see Figure 2). It also shows email 
notifications, SMS, and other news. 


From top to bottom 


A quick swipe from the left edge of the screen opens the 

starter bar (see Figure 3). This shows the important 

apps, with the selection adjustable. Pressing one of the 

| icons for a while opens a context menu. If you drag it 
from the left toward mid-screen, you wipe the current 

| app to the background and access the main menu (see 
Figure 4). 


| From left to right 


| A short swipe from the right toggles between the cur- 
rent and the previously invoked application. Dragging 
farther into the screen shows an index card view of all 
currently open apps (see Figure 5). Dragging an app to 
the top and out of the picture shuts down the app. 


| From right to left 


A swipe from the bottom screen edge opens the context 
menu for each application. This has different functions 
depending on the program. With phone applications, for 
example, this gesture opens the call list. 


From bottom to top 
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Figure 3: The main view provides access to all 
installed apps. 


you can seamlessly switch on a tablet 
between the mobile interface and the 
Ubuntu desktop [7]. 

Canonical thereby could achieve 
what no other manufacturer has 
done: the full porting of an operating 
system with interchangeable user in- 
terfaces. 

The mobile device could thus 
change its guise - if desired - to a 
personal computer that you can trans- 
port with all its data. Unfortunately, 
the Bq Aquaris E4.5 is a bit too weak 
for this function and cedes it to other, 
more powerful devices. 


APPS EN MASSE 
Canonical made sure that at the 
launch of the first official Ubuntu 
phone more than 1,000 apps (accord- 
ing to the distributors) would be 
available. Nevertheless, certain key 
applications like Whatsapp are miss- 
ing. Meanwhile, users must make do 
with alternatives like Telegram [8]. 
Regardless of what’s said about 
Whatsapp from a privacy perspective, 
the absence of this and similar apps 
is a major downside. There is a Face- 
book application, but it consists of 
only one web page - more like mere 
window dressing. 
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Figure 4: A long swipe from right to left pulls 
the application view into the foreground. 


The Ubuntu phone easily synchro- 
nizes contacts and calendars from 
Google accounts, and Ubuntu Touch 
takes over appointments in a native 
calendar app. 

The Google Maps replacement 
is a web app with Nokia’s Here 
[9] map service. There is also a web 
app for Google Mail, with the promis- 
ing mail program Dekko [10] as an al- 
ternative. Dekko is still in beta, but it 
is showing no more major weak- 
nesses. 

A document viewer, assignment 
and reminder app, video players, and 
music program are also on board right 
from the factory. Several good games 
are also included from the start. All in 
all, the device makes a well-rounded 
impression, even if the selections 
have some growing to do. 

A special feature of Ubuntu Touch 
are the so-called scopes. The basic 
idea is something like the home 
screen widgets you get with Android. 
Unfortunately, scopes with Ubuntu 
Touch take up the entire screen, are 
not necessarily associated with an ap- 
plication, and are on the level with 
the application view as soon as you 
mark them as favorites. Thus, you 
can have a scope marked My Music, 


another one for Vimeo, news, and 
many other full-screen widgets. 


CONCLUSION 

The Aquaris E4.5 Ubuntu Edition, 
based on a price-performance ratio, is 
on a level with comparable Android 
smartphones of the class. The new, 
well-thought out operating system 
leaves you wanting more - even when 
a few quirks tarnish the overall im- 
pression a bit. 

The operating concept using swipe 
gestures seems more complicated 
than it really is. The selection of apps 
is naturally not as full as with estab- 
lished smartphone systems, but the 
major ones for everyday use are 
there. Converts from other systems 
will soon find themselves at home, 
because Ubuntu Touch borrows vari- 
ous operating concepts from estab- 
lished systems. 

The Ubuntu phone is certainly a 
must for technical enthusiasts, devel- 
opers, and hardcore Linux fans. How- 
ever, even regular users who just 
want a simple yet technically pioneer- 
ing operating system should consider 
the Aquaris E4.5 Ubuntu Edition and 
its successors. e 


INFO 

[1] Ubuntu Phone: http://www. 
ubuntu.com/phone 

[2] QML: http:/doc.qt.io/qt-5/ 
gmlapplications.html 

[3] Bq Aquaris E4.5 Ubuntu Edition: 
http:/www.bq.com/gb/ubuntu. 
html 

[4] Bq Aquaris E4.5 Android: Attp:// 
www.bq.com/gb/products/ 
aquaris-e4-5.html 

[5] Installing Ubuntu for devices: 
https://developer.ubuntu.com/en/ 
start/ubuntu-for-devices/ 
installing-ubuntu-for-devices 

[6] Ubuntu Edge: Convergence in ac- 
tion: https:/www.youtube.com/ 
watch?v=bk9-v8Sl4yU 

[7] Convergence in action on 
Ubuntu: https:/www.youtube. 
com/watch?v=c3PUYoa1c9M 

[8] Telegram: https:/telegram.org 

[9] Here maps: https:/www.here. 
com 

[10] Dekko: https:/launchpad.net/ 
dekko 
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DVD Usuntu 15.04 — Vivip VERVET 


Ubuntu 15.04 — Vivid Vervet, 32 & 64 bits 


ON THE DV 


A F 


This month, on our double-sided disk, we have the newest ver- 
sion of Ubuntu, 15.04 - Vivid Vervet. Vivid is the most mature 
and stable version of Ubuntu to date and comes with the latest 
and greatest Free Software. Vivid comes now with systemd for 
its system back end, making it faster to boot, more stable, and 
with improved performance. 


On side B, you'll find the 64-bit version of Ubuntu. This will 
work better on more modern machines and will deliver a faster 
and more optimized experience. If in doubt, try this version 
first. 

Side A comes with the 32-bit version of Vivid, ideal for older 
machines or if you have compatibility problems with libraries 
or apps. 


UBUNTU 15.04 
+ Unity 7.3 


+ Linux kernel 3.19 
+ Firefox 37 

* Thunderbird 31.6 
+ LibreOffice 4.4 


* Gnome Terminal 3.14 


+ Ubuntu Make developer tools 


DougLe-Sinen DVD 
This DVD is a double-sided live disk. 
You can try out the operating systems 
on the disk without installing anything 
on your computer. You can later install 
Ubuntu from the live desktop. 

This DVD has a label on side A of the 
disk, so if you want to run Ubuntu 
15,04 — 64 bits, the side with the label 
should be facing up in the tray. If you 


ADDITIONAL RESOURCES want to use an Ubuntu for 32 bit com- 
ae 7 puters, you should insert the DVD in 
[1]: Ubuntu Men 2 your reader with the side with the 
ubuntu.com 


label facing down. 
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The Linux terminal, the shell, or whatever name you know it by, is ubiquitous in the Linux world. 


Although it was created in the 1970s, the earliest days of modern computing, it has not outlived its 


usefulness. 


Back to basics with the Bash terminal 


SHELL SUPREMACY 


BY PAUL C. BROWN 


e’ve done this before. In 

Ubuntu User #21 [1], we 

also dedicated our cover 

story to the shell. Back 
then, we talked mainly about scripting. 
We showed how to add “graphical” text 
menus to terminal-based apps, how to 
clean up your code to make it more legi- 
ble and maintainable, and how you 
could make Bash scripts more efficient 
and faster by compiling them into ma- 
chine code. 

This time, of course, it’s different. In 
fact, it is impossible to cover everything 
the shell can do in one, may I say, puny 
cover section. Whole big, bulky, and 
very heavy books have been written 
about the subject after all. And, if that 
were not enough, the shell has grown a 
lot since its inception: New instructions, 
old instructions that have learnt new 
tricks, and improved and repurposed 
versions of classic commands all guaran- 
tee that writing a complete treatise on 
the subject is all but impossible. 

In this issue, we bring you an illus- 
trated guide to the shell. We’re broach- 
ing low-level, very basic commands this 
time around - the building blocks, as it 
were, of which whole systems are made. 
To make things simpler, the articles 
themselves include comprehensive ta- 


INFO 

[1] Ubuntu User, Issue 21: http:// 
www.ubuntu-user.com/Magazine/ 
Archive/2014/21 


[2] Sample text files and scripts for 
this issue: ftp://ftp. 
linux-magazine.com/pub/listings/ 
ubuntu-user.com/25/ 
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bles listing common and exotic (al- 
though always useful) options for each 
instruction, along with screenshots 
showing how to use them in context. 
Visit our FTP site [2] to get the sample 
files and the longer scripts so you can 
start practicing immediately on data ma- 
nipulation and file processing from the 
command line. 

As mentioned above, you'll learn the 
very basic, but powerful, instructions 
that are the cornerstones of all Unix sys- 
tems: things like the sed, awk, cat, and 
other text and data manipulators; the es- 
sential looping structures and how to 
use them for advanced process control; 
and the mechanisms used to capture 
user input or events that happen while 
the system is running. 

These tools will give you the basics on 
which to build 
bigger things and 
start you on the 
road to becoming 
a true shell guru. 

Much has hap- 
pened since the 
shell was built 
into code by Ken 
Thompson back 
in 1971. Al- 
though it is now 
possible to live 
and work with a 
modern Linux 
operating sys- 
tem, such as 
Ubuntu, and 
never or very 
rarely feel the 
need to drop 
down into the 
terminal, users 


who ignore the power of the command 
line are cutting themselves off from one 
of the most powerful, if not the most 
powerful, toolset in modern computing. 

Knowledge of the shell will make you 
more efficient, in the eyes of your peers, 
nearly superhumanly so. With a handful 
of commands linked by pipes, you will 
be able to solve problems that would 
force others to slog through tens, nay 
hundreds of files, carrying out repetitive 
tasks. 

And, because the shell is largely uni- 
versal (it’s even available on Macs!), you 
can be sure that, even when faced with 
unfamiliar or buggy graphical tools, you 
can always open a terminal and get work 
done. 

So, turn the page, fire up your termi- 
nal window, and get hacking. e 


D 


With sed, you can edit text data without an interactive user interface, using pipes or input 
redirection. Sed lets you execute extensive editing commands on a single line. 


Shell Practice: Introduction to the sed stream editor 


Quick EDIT 


BY HARALD ZISLER 


he sed stream editor [1] auto- 

mates many repetitive operations, 

especially effectively inside a shell 

script. You can use regular expres- 
sions (regex) to provide a “nature” of the 
string. In this article, I’ll start with the 
program screen output. If you want to 
participate and practice, simply type the 
text files in an editor of your choice. 


SED COMMANDS 

The program calls up and accepts com- 
mands from virtually anywhere. You can 
pass commands directly or read them in 
from a separate file. The data can be 
piped, redirected, or input from a text file. 
The output can be sent to the screen 
(usually stdout), through a pipe to the 
next command, or redirected to a destina- 


tion file. With sed itself, no files are ever 
overwritten! The “Sed Call Options” box 
has the details. To resolve shell variables, 
you sometimes need to substitute the ' 
character with the " character. 


SYNTAX 
The basic syntax structure is shown in 
Figure 1. You’ll notice for all locations 
where the editing commands should be 
used that addressing is required. You can 
provide many addresses as long as doing 
so doesn’t affect clarity. If you want to 
change “everything except,” you can ne- 
gate the addressing with the ! character. 
You can add multiple commands on 
one command line to sed as follows: 


sed -e 'commandl' -e ‘command2’ .., 2 


-e ‘commandy’ .... 


Or, you can add these commands in a 
script file. 


SCRIPT FILES SED 
The script file should have a single line 
for each statement. For example: 


s/Gans// 
s/jo/Jo/g 


The instructions remove the word 
“Gans” - rather, it substitutes “nothing” 
for the word, but only for the first in- 
stance of the search string. The second 
lines substitutes “Jo” for “jo” for all in- 
stances because of the g option. 

To create an executable sed script, in- 
clude the shebang (#!) interpreter state- 
ment on the first line: 


Sep CALL OPTIONS 


LISTING 1: TEXTDATA.TXT 


Sed simply reads the text file and re- 
turns the results through stdout: 

sed [COMMAND] CTEXTFILE] 

Same with input redirection: 


chris hemsworth - Thor 0885465468798746 
Scarlett Johansson - Black Widow 08755466584 
Robert Downey - Iron Man 0987654321 

Mark Ruffalo - Hulk 0405458765143321 

Chris Evans - Captain America 0548/9988776655 


LISTING 2: 
TESTLIST.TXT 


22 April 1984 
7.04.1985 
30 March 1986 


sed CCOMMAND] € [TEXTFILE] Re nu 19 April 1987 
Inclusion of sed in one or more pipes: Ton Hiddieston - Loki 87841487014848 03.04.1988 
CPROGRAMI] | sed [COMMAND] | ...... Samuel Jackson - Nick Fury 043/956026386 26 March 1989 
Commands stored in a separate file Cobie Smulders - Maria Hill 23514560145 15 April 1990 
and read in: Hugh jackman - Wolverine 801539193Paul Rudd - Ant Man 497349000 31-March-1991 
. sed -f [SCRIPT] ..... 19 April 1992 
Output of sed redirected to a text file, 11 April 1993 
but omitting error messages: If you make the script executable (e.g., Listing 1 to exercise 3 April 1994 
sed [COMMAND] > CTARGETFILE] chmod 700 [SCRIPTNAME]), you can callit your sed skills. This 16. April 1995 
The same, but including error mes- like any other program. You wouldn’t nor- file looks as though 7 April 1996 
sages into the target file: mally use this option. Rather, you would it has been thrown 20 Mare 1007 
| sed [COMMAND] > CTARGETFILE] 2381 put sed and any script file calls in a shell together and con- 12 April 1998 
script. In some cases, the order of the com- tains empty lines, 
mands matters. Test typos, and other er- 
sed [-OPTIONS] [ADDRESS [, another ADDRESS] [1] EDITING COMMAND [ARGUMENT] your scripts before rors. The second sample file I’ll use in 
ell Î Î making them “real” this article is called testlist.txt (Listing 2) 
AGRE 7 zi to avoid errors and and has dates formatted in different ways 
e data loss. as content. 
SAMPLE DATA REGULAR EXPRESSIONS 
You can use the Some regular expressions are used in sed. 
textdata.txt file in You can use them to describe many string 


TABLE 1: SPECIAL CHARACTERS 
Character Function 
Opens statement 


Ends statement 


Opens optional statement 


patterns. The more of them you use in sed, 
the more confusing it can get with more 
complex statements. Here, sed scripts can 
often help. Some characters are valid as 
special shell characters as well as regex in- 


Opens a list of characters 


( 
) 
{ 
} Closes optional statement 
[ 
] 


Closes a list of characters 


sil 


$ sed -n '/[Mm]an/p' textdata.txt 
Robert Downey - Iron Man 0987654321 | 
Hugh jackman - Wolverine 801539193 
Paul Rudd - Ant Man 497349000 


Masks a statement in which shell variables are resolved 


Masks a statement in which shell variables not resolved 


Figure 2: Searching for Man, jackman, etc. 


Encloses a statement block 


Any character other than a newline 


Sets labels (tand bcommand) 


$ sed -n '3,5!'p textdata.txt 
chris hemsworth - Thor 088546546879874 


Chris Evans - Captain America 0548/998 
Jeremy renner - Hawkeye! 555/8812470 | 
Separates parameters, such as line items [Tom Hiddleston - Loki 87841487014848 
Samuel Jackson - “Nick Fury op 
Cobie Smulders - Maria Hill 2351456014 
Hugh jackman - Wolverine 801539193 


$ à End of document, end of line or last line Paul Rudd - Ant Man 497349000 

& Placeholder for search patterns, included in the replacement statement i 0 fli tone 

re) Figure 3: Output of lines except 3 through 5. 

/ Separator in editing commands $ sed -n ‘/Man/l'p textdata.txt 

TER = RP hris hemsworth - Thor 088546546879874 

x Beginning of line, or negation in a search pattern 
Scarlett Johansson - Black Widow 08755 

\ Escape character Mark Ruffalo - Hulk 0405458765143321 

! After a line number: do not output this line hris Evans - Captain America 0548/998 
Jeremy renner - Hawkeye 555/8812470 

X 0 Or any number of times Tom Hiddleston - Loki 87841487014848 
Samuel Jackson - Nick Fury 043/9560263 

+ Pattern present at least once ie smulders - Maria Hill 2351456014 


Output line number 


\n Newline, line feed 


ae jackman - Wolverine 801539193 


\t Tab character 


ing “Man”. 
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Figure 4: Output of lines except those contain- 
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TABLE 2: SED OPTIONS 


Action 

Execute command (can usually =e 

be omitted) 

Disable data buffering eu 

Treat files separately ZS; 

Use extended regexes on 

Create backup file -i CFILEEXTENSION] 
Read and execute script file -f [SCRIPTFILE] 
Suppress (unaffected) text areas |-n 

Show version “Vv 


TABLE 3: EDITING COMMANDS 
Action 


Command 


Add lines above this one 

Add lines below this one à 

Output this line p 

Output this line with a maximum length 1 [LENGTH] 
Replace signs with others y 

End sed q 

Replace text in this line G 

Delete this line d 

Search and replace s 


$ sed -n '/[H]\|[G]/!'p textdata.txt | 
chris hemsworth - Thor 088546546879874 


Scarlett Johansson - Black Widow 08755 
Robert Downey - Iron Man 0987654321 | 
Chris Evans - Captain America 0548/998 


TABLE 4: EDITING COMMAND OPTIONS 
Action 

Output line number 
| All occurrences 

| Outputs modified line with the s editing command | p | 
| Write the edited line in the file E 


structions. These 
you need to “es- 
cape” with the \ 
character (Table 
1). The construct 
[ABC] means 
“contains A or B 
or C” and the con- 


more patterns), the statement is applied to 
all lines (except the first) matching the first 
address, up to and including the next line 
matching the second address. 

Note that in Figure 6, the j comes be- 
fore J in the text file. In the first example 
in Table 6, none of the lines containing 
H and J are output, which works be- 


struct /ABC/ cause the order in the command and text 
means “contains file are the same. The second example 
exactly that with the negated H and j shows, how- 
string.” ever, that a line containing H must first 
be found. That’s why johann still ap- 
OPTIONS AND pears in the output! 
EDITING If you want be certain in a clear way that 
COMMANDS sed is doing what you need it to do, you 
Confusingly, both can combine several calls in the pipe. The 
sed and the edit- following command suppresses empty 


ing commands lines and “Man” (see Figure 8): 


have their own options. As is usual in 
Linux, these options are preceded with the 
- character. The editing statements take 


cat textdata.txt | sed -n 2 
'/E:alnum:]/'p | sed -n '/Man/!'p 


their options after them. Tables 2-4 provide 


SUBSTITUTING AND REMOVING 
You use the s instruction to replace 
matched expressions. The length of search 


$ sed -n ‘/[R]./,/[M]./1'p textdata.t 
chris hemsworth - Thor 08854654687987: 


Scarlett Johansson - Black Widow 08755 
Chris Evans - Captain America 0548/99 
Jeremy renner - Hawkeye 555/8812470 


Samuel Jackson - Nick Fury 043/956026: 3 
oa Rudd - Ant Man 497349000 i an overview. 
is | 

Figure 5: Output of lines except those contain- SEARCHING 
ing “H" or “G." 


You can use the search function among 
other things to replace text sections. The 
search query represents the addressing. 
You can also use regex for search patterns. 
Table 5 show some of the possibilities, and 
Table 6 provides some examples. In this 


and replace strings is irrelevant. You can 
see the detailed syntax shown in Figure 9. 

You can limit the search and replace 
statement to specific lines by preceding 
command with the line number as shown 
in the following example: 


[Tom Hiddleston - Loki 87841487014848 
Samuel Jackson - Nick Fury 043/956026. 
Cobie Smulders - Maria Hill 235145601. 
AY jackman - Wolverine 801539193 


table, sed is used 
both in the data 
stream and the direct 
access to the text file. 
With composite ad- 
dressing (two or 


Figure 6: Output lines except those containing 
an “R” somewhere followed by an “M” some- 
where else. 


$ cat textdata.txt | sed -n ‘/[:alnum:]/'p ] 
chris hemsworth - Thor 0885465468798746 

Scarlett Johansson - Black Widow 08755466584 

[Robert Downey - Iron Man 0987654321 

Mark Ruffalo - Hulk 0405458765143321 

Chris Evans - Captain America 0548/9988776655 | 
Jeremy renner - Hawkeye 555/8812470 | 
om Hiddleston - Loki 87841487014848 | 
‘Samuel Jackson - Nick Fury 043/956026386 

Cobie Smulders - Maria Hill 23514560145 

Hugh jackman - Wolverine 801539193 

FE Rudd - Ant Man 497349000 

S 


Figure 7: Output all lines that contain alphanumeric characters (no 
empty lines or lines containing spaces, tabs, etc.). 
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$ cat textdata.txt | sed -n '/[:alnum:]/'p | sed -n '/Man/!‘p| 
chris hemsworth - Thor 0885465468798746 | 
Scarlett Johansson - Black Widow 08755466584 | 
Mark Ruffalo - Hulk 0405458765143321 

Chris Evans - Captain America 0548/9988776655 
Jeremy renner - Hawkeye 555/8812470 | 
Tom Hiddleston - Loki 87841487014848 
Samuel Jackson - Nick Fury 043/956026386 
Cobie Smulders - Maria Hill 23514560145 
Hugh jackman - Wolverine 801539193 

$ 


Figure 8: Processing several instances of sed using a pipe. 


sed -n '[LINE NUMBER(n)]/S/[SEARCH PATTERN] /REPLACEMENT/[OPTION for s) 
TERN, 


jasegi 


Figure 9: Syntax of the search and replace statement. 
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sed -n '5s/OLD/NEW/p" [TEXTFILE] 
Or, for a range of lines: 
sed -n '1,4/0LD/NEW/p' CTEXTFILE] 


You can also suppress changes to certain 
lines using the exclamation point: 


sed -n '20-80!s/OLD/NEW/p' [TEXTFILE] 


Furthermore, you can limit changes to lines 
which contain certain strings or patterns 
that are not the same as the search and re- 
place statement: 


sed -n '/[STRING|PATTERN]/s/OLD/2 
NEW/gp' CTEXTFILE] 


You can delete the matched string with an 
empty string. 

The first occurrence of the search string 
on a line is processed. To replace all in- 
stances, add the g (greedy) option at the 
end of the statement. The stream editor can 
be a silent partner if the -n option is set. So, 
if you want to see what's going on, add the 
p (print) option. You can also write results 
to an output file with the w (write) option. 


$ cat textdata.txt | sed -n 's/e/E/p' | 
chris hEmsworth - Thor 088546546879874 
Scarlett Johansson - Black Widow 08755 
RobErt Downey - Iron Man 0987654321 | 
Chris Evans - Captain AmErica 0548/998 
JEremy renner - Hawkeye 555/8812470 

Tom HiddlEston - Loki 87841487014848 
SamuEl Jackson - Nick Fury 043/9560263 
CobiE Smulders - Maria Hill 2351456014 
Hugh jackman - WolvErine 801539193 
$ cat textdata.txt | sed -n 's/e/E/gp' 
chris hEmsworth - Thor 088546546879874 
Scarlett Johansson - Black Widow 08755 
RobErt DownEy - Iron Man 0987654321 
Chris Evans - Captain AmErica 0548/998 
JErEmy renner - HawkEyE 555/8812470 | 
Tom HiddlEston - Loki 87841487014848 | 
SamuEl Jackson - Nick Fury 043/9560263 
CobiE SmuldErs - Maria Hill 2351456014 
Hugh jackman - WolvErinE 801539193 | 


Figure 10: Using the “greedy” (g) option. 


$ sed -n ‘s/Man//gp' textdata. txt 
Robert Downey - Iron 0987654321 
[Paul Rudd - Ant 497349000 


Figure 11: Deleting the word “Man”. 


f cat textdata.txt | sed -n ‘4s/Iron/Tin/gp'l 
lobert Downey - Tin Man 0987654321 


Figure 12: Limiting the search and replace to 
one line. 


$ sed -n ‘/[Mmjan/s/0/089/gp' textdata. txt| 
Robert Downey - Iron Man 089987654321 
Hugh jackman - Wolverine 80891539193 
Paul Rudd - Ant Man 497349089089089 


Table 7 shows some 
short examples. 


TABLE 5: PATTERNS AND ADDRESSING 


You can see a Action 
more complex ex- All lines 
ample in Listing 1. Line 25 25 
It converts the in- Not line 25 25! 
consistently for- Lines 10 through 20 10,20 
matted date syntax Lastline $ 
in testlisttxttoa [Not pattem rene | 
common, unified, 1 
a ees Character at beginning of line ACHAR 
(DD/MM/YYYY) Sina 7STRING/ 
format. Be sure to th aR 
press the Enter key aractenset CHARS 
immediately after Any character [:alpha:] 
the \ at the line’s Lowercase [:lower:] 
end. Alternatively, Uppercase 
you can omit the Alphanumeric [:alnum: 
sign and use the Digit :digit: 
pipe character to H F fea Re 
exadecimal digit :xdigit: 
connect with the Tab and 2 ES 
line that follows it; a2 ane spano. EMS = 
however, this re- Space Ise De Cs 
sults in a less clear Control character :cntrl:] 
screen display. Printable characters (no control characters) sprint: 
The list is read in Visible characters (without spaces) C:graph:] 
line 1 and starts the ; 
Punctuation :punct:] 


pipes in line 2. Line 
2 takes any par- 
tially present leading space characters and 
substitutes the number 0. Line 3 replaces 
any minus signs in dates with spaces. 
Lines 4 and 5 substitute any month written 
as a word with its numeric values followed 
by a dot. Line 6 substitutes any two-digit 
numbers at the beginning of a line (4), 
with the first being 1 through 3 and the 
second with any digit, and any space char- 
acter with “itself” (&) followed by a dot. 
To make the search pattern repeatable 
during the replacement, enclose it in pa- 
rentheses - which 
you have to be sure 


string into the replacement patterns in the 
replacement statement. Check out the fol- 
lowing example: 


echo “happy” | sed -n s'/happy/un&/'p 
This example replaces happy with un- 
happy. You can also convert from lower- 


case to uppercase: 


cat textdata.txt | 2 
sed -n s'/\([0:1ower:J11\)/\U8/'pg 


$ sed -n ‘/[MmJan/1s/6/689/gp' textdata.txt — ass | 
hris hemsworth - Thor 089885465468798746 | 


Figure 13: Limiting the search and replace to 
selected lines. 


to escape with \. 
The sed statement 
in line 7 deletes all 
existing space char- 
acters (through the 
g option for s). 

The uniq com- 
mand on the last 
line ensures that 
all duplicate lines 
are uniquely out- 
put. Figure 16 
shows the results. 
You can also 
“carry over” all or 
part of the original 
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Scarlett Johansson - Black Widow 0898755466584 
Mark Ruffalo - Hulk 08940895458765143321 

Chris Evans - Captain America 089548/9988776655 
Jeremy renner - Hawkeye 555/881247089 

Tom Hiddleston - Loki 8784148708914848 

‘Samuel Jackson - Nick Fury 08943/95608926386 
ee smulders - Maria Hill 2351456080145 


Figure 14: Excluding lines for the search and replace statement. 


$ cat textdata.txt | sed -n s'/[0-9\/-]//'gp 
chris hemsworth Thor 

Scarlett Johansson Black Widow 

Robert Downey Iron Man 
Mark Ruffalo Hulk 

Chris Evans Captain America 
Jeremy renner Hawkeye 

Tom Hiddleston Loki 
Samuel Jackson Nick Fury 
Cobie Smulders Maria Hill 
Hugh jackman wolverine 
Paul Rudd Ant Man 


Figure 15: Deleting numbers and symbols from lines. 
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+ FEATURES 


Search for 


TABLE 6: SAMPLE SEARCHES AND PATTERNS 


Pattern Example 


Figure 


Term, Name "/TERM/* textdata.txt | sed -n '/Meier/p' - 

All lines containing “man” or “Man” ‘/CMmlan/p"' sed -n ‘/[MmJan/p' textdata.txt Figure 2 
All lines except 3 through 5 stale sed -n '3,5!'p textdata.txt Figure 3 
All lines except those containing “Man” | '/Man/!' sed -n '/Man/!'p textdata.txt Figure 4 
Lines containing “H” or “G” '/TH|GI1/" sed -n '/[H|G]/'p textdata.txt = 

Lines not containing “H” or “G” "/CHIN|LGI/!' sed -n '/[HI\|[G]/!'p textdata.txt Figure 5 
Line 3 cat textdata.txt | sed -n '3p' - 

Last line cat textdata.txt | sed -n ‘$p' - 
Multiple patterns: Do not output lines "/CRI./,/CM1./l' | sed -n '/CR]./,/CM1./l'p textdata.txt Figure 6 
containing an “R” somewhere followed 

by an “M” somewhere else 

All lines containing some alphanumeric |'/[:alnum:]/" cat textdata.txt | sed -n '/ Figure 7 
characters (not all space characters) [:alnum:]/'p 


The \U before the & indicates the output 
must be converted into uppercase. You 


at testlist.txt \ 
sed '/A[\ ]/'s'/\ /0/'p \ 
sed s'/-/ /'pg \ 
s'/March/03\//'p \ 
s'/Apri1/04\//'p \ | 
s'/A\([e-3][0-9]\ \)/a\//'p \ 
s'/\./\//'gp \ 
s'/\ //"gp \ 
> | uniq 


22/04/1984 
07/04/1985 
30/03/1986 
19/04/1987 
03/04/1988 | 
26/03/1989 | 
15/04/1990 | 
81/03/1991 
19/04/1992 | 
ass 04/1993 
03/04/1994 
1167 04/1995 
[07/04/1996 
[30/03/1997 


Figure 16: Formatting dates. 


g 
> 
£ 


VV VVV 


eee) 


$ cat textdata.txt | sed '/Ac/'y'/c/Cc/' 
Chris hemsworth - Thor 9885465468798746| 


Scarlett Johansson - Black Widow 087554| 
Robert Downey - Iron Man 0987654321 
Mark Ruffalo - Hulk 0405458765143321 | 
Chris Evans - Captain America 0548/9988) 
Jeremy renner - Hawkeye 555/8812470 
Tom Hiddleston - Loki 87841487014848 
Samuel Jackson - Nick Fury 043/95602638 
Cobie Smulders - Maria Hill 23514560145 
Hugh jackman - Wolverine 801539193 
a. Rudd - Ant Man 497349000 

$ 


Figure 17: One-for-one character replacement. 


can do the following: 


cat textdata.txt | sed 2 
-n S'/\(CC:upper:]J/\L&/'pg 


to convert from uppercase to lowercase. 


CHARACTER REPLACEMENT 

Use the y option for character filtering 
and other applications. The pattern 
should contain all the characters that 
need to be replaced, and the replace- 
ment statement should have the same 
number of characters. The command 
structure should only have s, and -n 
should be omitted: 


sed y'/[Search CHAR]/[Replacement CHARJ/' 
Substitute the first character of only the 
lines in textdata.txt that begin with c in 
lowercase characters with uppercase 
character C (Figure 17). 

cat textdata.txt | sed '/Ac/"y'/c/C/* 
You use c to replace entire lines: 


sed 'PATTERN'c'REPLACEMENT* 


You can also do it 


$ cat textdata.txt | sed ‘/A\ *$/'c’ 
chris hemsworth - Thor 0885465468798746 


like this: 


Scarlett Johansson - Black Widow 08755466584 


Robert Downey - Iron Man 0987654321 
Mark Ruffalo - Hulk 0405458765143321 


Chris Evans - Captain America 0548/9988776655 


(Jeremy renner - Hawkeye 555/8812470 

‘Tom Hiddleston - Loki 87841487014848 
[samuel Jackson - Nick Fury 043/956026386 
Cobie Smulders - Maria Hill 23514560145 
Hugh jackman - Wolverine 801539193 

pau Rudd - Ant Man 497349000 


sed [LINE(n)] 2 

| c* REPLACEMENT" 
The following ex- 
ample deletes an 

| empty line and re- 


Figure 18: Replacing an entire line matched to a search pattern. 
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places it with a se- 
ries of dashes: 


cat textdata.txt | 2 
sed '/9\ A$/'G'-----... y 
Figure 18 shows the result. 

In place of a search pattern, line num- 
bers can be used. Be aware that even if 
you specify multiple line numbers they 
will all be replaced by one single instance 
of the replacement string. So, if you pick 
three lines, it will seem like the first line 
gets replaces, and the second and third 
lines get deleted (Figure 19). 

The first example below deletes line 2 
and substitutes a series of hash marks. 
The second example deletes lines through 
4 and replaces them with the given line. 


cat textdata.txt | sed 2 
2c ' HHHHHHHHHHHHHHHHHHHHHHHHHHHAHHHE" 


cat textdata.txt | sed 2 
2,4c'Remaîning Members 


You also can delete lines using the d op- 
tion and using a search pattern or line 


numbers: 


sed '/PATTERN/'d 
sed [LINE(n)]d 


LISTING 3: Process DATES 


01 cat testlist.txt \ 

02 | "PAIN J/'s'/\ /0/'p \ 
03 | s'/-/ /'pg \ 

04 | s'/March/03\//'p \ 


sed 
sed 
sed 


05 | sed s'/Apri1/04\//'p \ 

06 | sed s*/*\({O-3][0-9]\ \)/8\//'p \ 
07 | sed s'/\./\//'gp \ 

08 | sed s'/\ //'gp \ 

09 | uniq 
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TABLE 7: SAMPLE SEARCH AND REPLACE STATEMENTS 


Action Example 

Replace pattern at the first occurrence only cat textdata.txt | sed -n 's/e/E/p' Figure 10 
Replace pattern at every occurrence cat textdata.txt | sed -n 's/e/E/gp' Figure 10 
Delete the word “Man” sed -n 's/Man//gp' textdata.txt Figure 11 
Replace “Iron” with “Tin” on line 4 cat textdata.txt | sed -n '4s/Iron/Tin/gp' | Figure 12 
Replace “0” with “089” on all lines containing “Man” or sed -n ‘/[Mmlan/s/0/089/gp' textdata. txt Figure 13 
man 

Replace “0” with “089” on all lines except those containing |sed -n ‘/[Mmlan/!s/0/089/gp' textdata.txt | Figure 14 
“Man” or “man” 

Delete all numbers and backslashes (4 and hyphens (-) cat textdata.txt | sed -n s'/[0-9\/-]//"gp | Figure 15 


s cat textdata.txt | sed 2c #H#HHHHHHHHHHHHHHH HHT THa AHH THTIE | 
chris hemsworth - Thor 0885465468798746 
PPEP 
Scarlett Johansson - Black Widow 08755466584 
Robert Downey - Iron Man 0987654321 

lark Ruffalo - Hulk 0405458765143321 

hris Evans - Captain America 0548/9988776655 
Jeremy renner - Hawkeye 555/8812470 

om Hiddleston - Loki 87841487014848 
Samuel Jackson - Nick Fury 043/956026386 

obie Smulders - Maria Hill 23514560145 

Hugh jackman - Wolverine 801539193 

Paul Rudd - Ant Man 497349000 

$ cat textdata.txt | sed 2,4c'Remaining Members' 
chris hemsworth - Thor 0885465468798746 
Remaining Members 


$ cat textdata.txt \ 

> | sed '1i NEW FIRST LINE NEW'\ 
> | sed '$a NEW LAST LINE NEW' 
NEW FIRST LINE NEW 

chris hemsworth - Thor 0885465468798746 


scarlett Johansson - Black Widow 08755466584 
Robert Downey - Iron Man 0987654321 

Mark Ruffalo - Hulk 0405458765143321 

Chris Evans - Captain America 0548/9988776655 
| Jeremy renner - Hawkeye 555/8812470 

Tom Hiddleston - Loki 87841487014848 

Samuel Jackson - Nick Fury 043/956026386 
Cobie Smulders - Maria Hill 23514560145 

Hugh jackman - Wolverine 801539193 


Mark Ruffalo - Hulk 0405458765143321 Ferrer penance 
Chris Evans - Captain America 0548/9988776655 LÉ wan AU COUND A APANI 
Jeremy renner - Hawkeye 555/8812470 hg ged ay ear (ba 

Tom Hiddleston - Loki 87841487014848 i 
a OOI Chris hemsworth - Thor 0885465468798746 


Cobie smulders - Maria Hill 23514560145 
Hugh eah - Wolverine 801539193 Scarlett Johansson - Black Widow 08755466584 
| 


Paul Rudd - Ant Man 497349000 ---- FOUND A "MAN" 
sii [Robert Downey - Iron Man 0987654321 | 


Figure 19: Replacing whole lines per line numbers. 


' textdata.txt\ | 
» | 


Mark Ruffalo - Hulk 0405458765143321 

Chris Evans - Captain America 0548/9988776655 
Jeremy renner - Hawkeye 555/8812470 

Tom Hiddleston - Loki 87841487014848 

Samuel Jackson - Nick Fury 043/956026386 


$ sh searchString.sh | 


Enter search string: Man | line, you indicate 


RO Bron Man, Rares ter the search pattern Cobie smulders - Maria Hill 23514560145 
F ; Hugh jackman - Wolverine 801539193 
sil or a line number. If | FOUND A "MAN" =-=- 
= you enter multiple Paul Rudd - Ant Man 497349000 
Figure 20: Deleting lines. line numbers or SE r a, 
the pattern E TES 


matches multiple Figure 21: Adding lines. 
times, the insertion 
occurs for each instance (Listing 4). 

In line 2 of the listing, a new line is 


added above the first line in the file; 


Using the following commands, you can 
search and delete an empty line and then 
delete line 4. Figure 20 shows an example. 


$ sh searchString.sh 
Enter search string: Man 
Robert Downey - Iron Man 0987654321 | 
cr Rudd - Ant Man 497349000 

$ 


cat textdata.txt | sed */^\ *$/"d 


cat textdata.txt | sed 4d 


ADDING AND INSERTING 

With a, you add lines beneath and, using 
i, you insert a lines above the search pat- 
tern. To state where you must insert the 


LISTING 4: INSERTING LINES 


01 cat textdata.txt \ 

02 | sed "1i NEW FIRST LINE NEW'\ 

03 | sed "$a NEW LAST LINE NEW" 

04 

05 sed '/Man/*i'---- FOUND A "MAN" ----' 
textdata.txt\ 

GES A Man ASS En Re ETES ss = 4 


whereas in line 3, it’s added at the end 
($). Line 5 adds a new line above the 
matched search pattern, and line 6 adds it 
below. You can see an example for the re- 
sult in Figure 21. 


SHELL VARIABLES 
If a shell variable needs to be resolved, 
you need to enclose the statements in 


LISTING 5: SEARCHSTRING.SH 


01 #! /bin/sh 

02 echo 
sstring 

03 cat textdata.txt | sed -n "/$sstring/"p 


-n “Enter search string: ";read 
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Figure 22: Handling variables in Bash scripts. 
double quotes (") instead of single 
quotes ('). The little shell script in List- 
ing 5 shows how to handle variables. It 
searches through the sample file and 
outputs the matching lines. Figure 22 
shows the result. 


CONCLUSION 
With sed, you can execute complex text 


manipulation without user intervention. 


Its cryptic syntax might seem cumber- 
some at first, which is why building 
scripts bit by bit is a great option. « 
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Programming loops allow one-time or multiple execution of instructions. The condition for the loop 
can exist both outside and inside it. 


Loops in shell scripts 


RUNNING IN 


BY HARALD ZISLER 


ith loops, you can exe- 
cute part of a shell script 
over and over until an 
ending condition termi- 
nates it. You can use loops in menu 
controls and data processing. With- 
out loops, you would need to start 


= 


CIRCLES 


the scripts every time you wanted to 
process a piece of data. 


BUILDING Loops 

A loop begins with for, while, or until 
(the loop header). After that follows 
a do statement that ends with done. 
Between do and done are the state- 
ments to execute (the loop body): 


for / while / until [LOOP HEADER] 
do 

[commands] [LOOP BODY) 
done 


In the loop body, apart from the com- 
mands, you can also add some con- 
trolling elements for the loop. 

For example, using the break com- 
mand, you terminate the loop execu- 
tion and let the rest of the script be 
processed. You use continue to termi- 
nate the current cycle and proceed to 
the next one. With both of these com- 
mands, you can indicate the number 
of levels you want to jump in nested 
loops. 


LISTING 1: SETTING PARAMETERS 
01 #! /bin/sh 

02 fork ina b c 

03 do 

04 echo $k 

05 done 
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If the script were expecting another 
program to run, you would use wait. 
With exit, you terminate the loop im- 
mediately and completely (wait and 
exit aren’t typical loop commands, 
but they do complement their func- 
tions in meaningful ways). 


For Loop 
A for loop requires a data feed. Each 
run-through is carried out for a single 
parameter that’s extracted from a list, 
calculated from an increment or ob- 
tained from another data source. Basi- 
cally, the for loop runs as long as the 
data is present. Of course, you can set 
a premature loop termination by using 
simple if or multiple case branching. 
You can set parameters for the loop 
processing, in the following form: 


for VARIABLE in PARAMETERL, 2 
PARAMETER? ...... 
do 


LISTING 2: SHELLCOUNTER.SH 


In practice, these parameters could 
be filenames, directories (backed up 
first!), users, applications, machine 
names, IP addresses, or anything 
else. Listing 1 shows a minimal ex- 
ample. Run it and see what it does. 
All code examples for this article are 
available online [1]. 

Using the built-in math skills of 
Bash, you can create a counter, a fea- 
ture missing in many other shells. 
Using counters, you can uniformly 
increment or decrement variables. 
Note that you should use #!/bin/bash 
as the first line of the shell script. 
Otherwise, you'll get error messages 
instead of counters. Take a look at 
Listing 2. 

The structure of the “calculated” 
for loop header begins with the defi- 
nition of the variable’s initial value. 
This is followed by a condition (mini- 
mum/maximum value of the vari- 
able) and the increment (or decre- 
ment) statement for the value. Figure 
1 shows the loop’s execution. 


01 #1 /bin/bash 

02 echo "increasing" 

03 

04 # "k=1" -> Variables initial value 

05 # "k<5" -> Condition (k must be less than 5 


15 echo $k 
16 done 


18 echo “increasing with a larger increment” 
19 for ((k=10; k<50; k=k+10)) 


to execute) 2040 
06 # "k++" -> Increment k by 1 in after each Let 
cycle 
07 for (kel; k¢5: ket) seat 
08 do es 
09 echo $k 24 echo “increasing with a quadratic 
10 done increment” 
11 25 for ((k=2; k<50; k=kAk)) 
12 echo “decreasing” 26 do 
13 for ((k=4; k>0; k--)) 27 echo $k 
14 do 28 done 
LISTING 3: DATASOURCE.SH 
01 #!/bin/sh 13 echo " " 
02 14 for k in “cat input.txt” 
03 echo "Determining the data type for a 15 do 
for-loop* 16 echo $k 
04 for k in $(1s -1) 17 done 
05 do 18 echo " * 
06 echo *- 19 
FRE d 20 echo "Database query (sqlite) as data 
07 file $k | fold -sbw 50 source" 
08 done 21 echo * " 
GERS EEE SEE EE 22 for k in $(sqlite3 test.db "select one from 
EE: > tb11 where two<500;") 
10 23 do 
11 echo" " 24 echo $k 
12 echo "Using a text file to derive values” 25 done 
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$ sh shellcounter.sh 
Increasing : 

al 

2 

3 

4 

Decreasing 

4 

3 

2 

1 

Larger increment 

10 

20 

30 

40 

Quadratic increment 
2 

4 


16 
li B 


Figure 1: Execution of the shellcounter.sh 
script. 


In the first two loops, the incre- 
ment/decrement value is 1. The third 
loop shows the calculation method 
for a different fixed increment value. 
In the last loop, you get a quadratic 
increment by multiplying the variable 
by itself. 

In this case, the initial variable 
value cannot be 0 or 1, or you’ll get 
an infinite loop. The parameters for 
the for loop can also come from other 
applications. The call takes the fol- 
lowing form: 


LISTING 4: WHILE1.SH 


01 #! /bin/sh 

02 k=O 

03 while [ $k -1t 5 J; 

04 do 

05 k=$(echo $k + 1 | bc) 
06 echo $k 

07 done 


LISTING 5: UNTIL1.SH 


01 #! /bin/sh 

02 k=0 

03 until £ $k -eq 5 1; 

04 do 

05 ke$(echo $k + 1 | be) 
06 echo $k 

07 done 
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$ sh datasource. sh 
Determining the data type for a for-loop 


datasource.sh: POSIX shell script, ASCII text 


for VARIABLE in 2 
SCLCALL APPLICATION]) 


executable 


text executable 


test.d 


Thor 
Black 
Widow 
Iron 
Man 
Hulk 
Captain 
America 
Hawkeye 


for1.sh: POSIX shell script, ASCII text 
executable 


shellcounter.sh: Bourne-Again shell script, ASCII 


Using a text file to derive values 


Database query (sqlite) as data source 


Or the following: 


for VARIABLE in 2 
© CCALL APPLICATION] 


You can use just 
about anything as 
the data source that 
produces unique 
values separated by 
spaces. 

In Listing 3, you 
first determine the 
types for all objects 
found by ls -1 in the 
current subdirec- 
tory using file. The 
fold is simply for 
output formatting: 


LISTING 6: INFINITE.SH 


01 #! /bin/sh 

02 k=0 

03 echo "while-loop” 

04 while true; 

05 do 

06 k=S(echo $k + 1 | bc) 
07 echo $k 


09 # End loop with a >> break << 


11 if [ $k -eq 5 J; 
12 then 

13 break 

14 fi 

15 done 


17 k=0 

18 echo "until-100p" 

19 until false 

20 do 

21 k=$(echo $k + 1 | bc) 
22 echo $k 


24 # End loop and program with >> exit << 


26 if [ $k -eq 5 J; 
27 then 

28 exit 

29 fi 

30 done 
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hello! 

goodbye It folds text at 50 
Er characters. 

ls E J You then read a 
Figure 2: Result of the datasource.sh shell script shown in Listing 3. text file that returns 


a name per line. 

Each loop cycle sets 
the k variable to one of these names. 
Finally, you read a filed called one 
from a database table for all the val- 
ues in the two field less than 500. The 
database table has just four entries 
and registers 1, 2, and 4 meet the con- 
dition. Figure 2 shows the results. 


WHILE AND UNTIL Loops 

A while loop runs as long as it meets 
the specified condition in the loop 
header. Of course, you could control 
the process independently of the 
header using continue, break or exit. 
The syntax is as follows: 


while [CONDITION] 


This type of loop, unlike a for loop, 
doesn’t do any processing by itself. 
Listing 4 shows a minimal example 
where the loop executes for as long as 
the $k variable is less than 5. It also 
shows you that you have to increment 
k separately in between do and done. 


LISTING 7: EXITING WITH CODE 3 


01 #! /bin/sh 


02 echo "Applying an exit code value of 3" 
03 exit 3 


The until loop runs until the condi- 
tion in the header becomes true (i.e., 
the condition has to be false for the 
loop to run), otherwise the rules are 
the same as for the while loop. Listing 
5 shows a sample script. 

The while and until loops are fol- 
lowed by a condition in the loop 
header. If you want an endless loop 
controlled from within the loop body, 
set the while loop to true or the until 
loop to false. The two statements set 
the conditions and return true as 0 or 
false as 1. 

Endless loops are used, for example, 
in menu control or monitoring tasks. 
Listing 6 shows an application of both 
types of loops. Note the use of break 
and exit to quit the loops. 

With continue, the loop is inter- 
rupted without executing any remain- 
ing commands and then restarted in 
the next cycle. Used inside nested 
loops, continue can even switch 


LISTING 8: EXITING.SH 


01 #! /bin/sh 

02 a=0 

03 b=0 

04 c=0 

05 while true; 

06 do 

07 

08 if [$a -eq 8 ]: 
09 then 

10 echo "That's it!” 
11 exit 

Ga 


14 a=$(echo $a + 1 | bc) 
15 echo "A: $a" 

16 if [$a-eq 5 J: 

17 then 

18 while true; 

19 do 

20 be$(echo $b + 1 | bc) 
21 echo "B: $b" 

22 if [ $b -eq 5 J: 

23 then 

24 while true; 

25 do 

26 e=$(echo $c + 1 | bc) 
27 echo "C: $c” 

28 if D $c -eq 5 1; 
29 then 

30 continue 3 

31 fi 

32 done 

33 fi 

34 done 

35 fi 

36 done 
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through several nested levels if you 
indicate the number of levels. The 
level number of the current loop be- 


gins with 1 and extends to the outside 
loops, the outer loop being the highest 


number. 


A continue without an argument re- 


fers to the currently executing loop 


only. (An example of multiple nested 
loop levels, with the continue near the 
bottom of the script, is shown later in 


Listing 8). 

You break off a loop using break. 
Here, too, you can jump over nested 
loop levels by indicating the level 
number. Listing 6 shows an example 
of using a break. 

If the script is to exit after a condi- 


tion is met, use exit and the loop will 


end and no further commands exe- 


cuted. Listings 6 and 7 show some ap- 
plications of a script abruptly ending. 
You can give the command its own 


exit code in the script to be used at 
another location. The short example 


LISTING 9: WAITAMOMENT.SH 


mOl #! /bin/sh 

02 

03 d=0 

04 a-0 

05 b=0 

06 c=0 

07 

08 while true 

09 do 

10 echo -n "Start the script: “;date 
+BHS 3M: 3S 

11 sh a.sh & 

12 PIDI=$! 

13 sh b.sh & 

14 PID2=$! 


S 


16 echo "Waiting for processes $PID1 and 
$PID2." 

17 wait SPID1 $PID2 

18 echo -n "End the script: ";date +%H:41 


20 # Applying and calculating the variables 


22 a=$(cat a.txt) 
23 b=$(cat b.txt) 
24 c=$(echo $a + $b | bc) 


25 d=$(echo $d + $c | be) 
26 echo "Subtotal: $d" 
27 

28 # Break when d > 30 
29 

30 if [ $d -gt 30 ]; 

31 then 

32 break 

33 fi 

34 done 


35 echo "Total: $d" 


in Listing 7 shows how this works. 
You can ask for the exit code immedi- 
ately after the command by using 
echo $?. 


SAMPLE Loop Booy 

The sample script in Listing 8 will 
count three times within nested loops. 
The end of the script is triggered by a 
condition in the “main” loop (exit). In 
the first level, the loop is interrupted 
and redirected to the main loop with a 
continue. The main loop then takes 
over again and continues counting 
until it meets an exit condition. Figure 
3 shows the result of the script. 


PAUSING WITH WAIT 

You can use wait to pause execution 
of one or more background tasks be- 
fore continuing. This command 
doesn’t strictly belong to loop control, 


LISTING 10: A.SH 


01 #! /bin/sh 
02 # a.sh 


03 


n=8 


04 sleep 5 


05 echo $n > a.txt 


LISTING 11: B.SH 


01 #1 /bin/sh 
02 # b.sh 


03 


n=3 


04 sleep 2 


05 echo $n > b.txt 


LISTING 12: MENU.SH 


01 #1 /bin/sh 


02 
03 
04 
05 
06 
07 
08 
09 
10 
11 
12 
13 
14 
15 
16 


17 
18 
19 
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while true 

do 

clear 

echo " 1 nanoeditor" 
echo " 2 htop" 

echo " 3 root login” 
echo * 4 disk usage /home” 
echo " 9 END" 

CHO SS Sie ES 
echo -n * *sread par 

if [ Spnr -eq 1 J; then nano 


elif 
elif 
elif 
sleep 
elif 
done 
echo 


E $pnr -eq 2 3; then htop 

[ $pnr -eq 3 1; then su - 

E $pnr -eq 4 J; then df -h /home; 
S 

L $pnr -eq 9 1; then break; fi 


"Requested program end." 


$ 


C 
C 
(0 
A 
A 
A 


Th 


sh exiting.sh 


NOOPWONRPUAWNHRUARWNHEH 


8 
at's it! 


Figu 


re 3: Output of exiting.sh. 


LISTING 13: EXAMPLE USING YAD 


01 
02 
03 
04 
05 
06 


#1 /bin/bash 


while true; 
do 


# Determine menu entries, field 


separator="!", expandable! 


actions="gedit!gnome-terminal!pcmanfm" 


action=S(yad --title="HEADING TEXT" 
~-text="TEXT_ABOVE_MENU" \ 

--form \ 

~-field="Action: ":CB factions \ 
--button="Cancel":1 \ 
--button="Start action":0) 


# End program with [CANCEL], use exit 
code 252 when ending with "X" 


ec=$(echo $?) 


if [ $ec -eq 1 J; 
then 
exit 
elif [ $ec -eq 252 J; 
then 
exit 
fi 


# Read selected action 
action=$(echo $action | cut -d \| -f1) 


# Call selected program 


exec $action & 
done 
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but it can be used in combination 
with it. Without this command, a loop 
would continue running after starting 
a background task, with some possi- 
ble undesired results. Using wait en- 
sures that the process stops and all 
necessary tasks are performed. 

Immediately after starting a pro- 
gram, the shell provides its process 
ID, which you can query with the $! 
variable. If you want to wait on multi- 
ple processes, place each of the IDs in 
its own variable. You pass the PIDs to 
wait, and it pauses the loop until all 
PIDs are removed from the process 
table. 

In practice, the background pro- 
cesses could be database daemons, 
web servers, or other entities. The two 
small shell scripts in Listing 9 use 
only one variable and are put to sleep 
(so that you can observe the process). 
Listing 10 shows the content of the 
shell script a.sh called by the script. 


LISTING 14: CLOSINGDOWN.SH 

01 #1 /bin/sh 

02 

03 # Hour when application is launched 
04 start_time=$(date +%H) 

05 

06 # An hour later (taking day transition 

into account) 
07 if [ Sstart_time -eq 23 J; 


08 then 

09 endhour=0 

10 else 

11 endhour=$(echo $start time + 1 | 
bc) 

12 fi 


14 # Start program 
15 firefox & 


17 # Read PID 
18 pid=$(echo $!) 


20 # Control loop 


22 while true; 

23 do 

24 

25 # Current hour 

26 hr=$(date +#H) 

27 

28 # If hr matches endhour, quit browser 
29 if [ $hr -eq $endhoun J; 
30 then 

31 kill -9 $pid 

32 exit 

33 fi 

34 # Wait 59 seconds 

35 sleep 59 

36 done 
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Listing 11 shows the content of b.sh. 
Inside the loop, a sum is calculated. 
When its value exceeds 30, the break 
ends the loop. Figure 4 shows the en- 
tire results. 


A TEXT MENU 


Listing 12 shows a pure text menu for 
terminal sessions. It runs a while true 
endless loop that ends with a break, 
allowing further commands after the 
loop to be executed. You can use this 
script as a kind of building block and 
modify or enhance it as needed. Fig- 
ure 5 shows the menu in action. 

You can create shell programs with 
GUI operations using Yad. The capa- 
bilities far exceed just menu control 
(you can, for example, use easy 
masks for database applications). The 
example shows a lot about the pro- 
cess even at a beginner’s level. List- 
ing 13 shows the example, and Figure 
6 shows the GUI script in operation. 

The menu is in an endless loop. Be- 
fore the menu, you set a variable with 
the menu selections in the form 
MENUITEM1!2MENUITEN2 ...... The 
yad GUI sets the action variable with 
the result of the selection. Its content 
after selecting the first item is PRO- 
GRAM|. The program name is discon- 
nected from the separator symbol 
with the cut command. 

The exec command starts the pro- 
gram in the background so that it’s 
possible always to access the menu 
and start other programs. If this is not 
what you want, you can just remove 
the & character at the end of the exec 
line. 

The yad --form presents the selec- 
tion in the --field, leading to the CB 
(Check box) option. Ending the loop 
involves evaluating the exit code, 
which you derive using the button 
statement (here with preset values). 
If you want to end the script by using 
X, you need to add a 252 after the 1. 

For the example, the actions were 
defined as the gedit editor, the 
gnome-terminal, and pcmanfm. You 
can substitute your favorite programs 
and change the headings as you 
wish. 


TRIGGER ACTIONS 
You may not always want to use at or 
cron to perform an action at a certain 


1 nanoeditor 

2 htop 

3 root login 

4 disk usage /home 
9 END | 


Figure 5: Menu for a terminal session. 


ə Ww HEADING TE. y ©) W 
TEXT_ABOVE_ MENU 


Action: | gedit S 


[ Cancel | | Start action | 


È 
Figure 6: Shell menu using yad. 


date or time. You might want a shell 
script to do it. 

The example shows a solution 
where a web browser exits without 
discussion after an hour’s time. You 
could take this further, for example, 
by ending your child’s session or even 
shutting down their computer. This 
also works for a small Internet café on 
your premises. 

Listing 14 shows how it works. The 
start and end times are first defined. 
For simplicity’s sake, the shell script 
is intentionally unfair - that means 
someone starting at minute one gets 
more time than someone else starting 
later on. 

Next, the browser is started and its 
process ID is stored in a variable. In 
the while true loop, a time test is per- 
formed every 59 seconds. Then, if the 
“closing hour” and current hour 
match, the browser process and script 
are terminated. 

As these examples have shown, 
shell loops can be very useful if you 
take the time to understand their syn- 
tax and applications. e 


INFO 


[1] Sample code from this article: 
ftp://ftp.linux-magazine.com/pub/ 
listings/ubuntu-user.com/25/ 
loops/ 
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HELL TEXT Ti 


With the jack-of-all-trades sed, you can certainly master any kind of text manipulation, but the 
result is often complex and hard-to-remember syntax. The helpers presented in this article replace 
or enhance sed for many smaller text editing tasks. 


Small shell tools for text editing 


TEXT TOOLS 


BY HARALD ZISLER 
any small programs can help To follow along with the examples 
you with your “word tasks” shown in this article, you can grab the 
in the shell. Table 1 shows files a.txt, b.txt, c.txt, d.txt, and e.txt 
an overview of which ones from our FTP server [1]. 


to use. Unless indicated otherwise, they 

work with single or multiple files as well © SHOWING, PIPING, AND 

as pipe operations. Some applications MERGING 

overlap in their functionality. The cat and tac tools differ mainly by 
the output order of the content: cat 
puts the file in its original order, and 
tac reverses the order. The scope of 
their options is also different (see Table 
2). You can also add line numbers 
using cat (Figure 1), including blank 
lines. 

Instead of sending output to the 
screen, you can send the content of a 
text file to another application for fur- 
ther processing. You can do this with 
both cat and tac. 

In the following example, the wc 
command (described later) counts the 
lines that cat passes on to it: 


cat a.txt | we -1 


For vertical or serial merging of text 
files (i.e., appending one file after the 
other), you can pass on the filenames 
as parameters and, optionally, a target 
file to copy the result into the follow- 
ing format: 


cat [FILE1] [FILE2] ... > (TARGETFILE] 


The target file isn’t necessary if you 
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want to pass the data through a pipe or 
to the screen. 


HEADS AND TAILS 
Using head, you output the beginning of 
a text file, and with tail, you output the 
end. These programs provide slightly dif- 
ferent options, as described in Table 3. 
You can use both commands for text 
files or pipes. 

In practice, you’ll mainly want to read 
a specific number of lines at the begin- 
ning or end of the file. Use the following 
to output the first five lines: 


head -n5 CTEXTFILE) 

Or, in the shortened form, use: 
head -5 (TEXTFILE] 

You could also possibly use: 


| head -n5 ..... 
gee | ead’ Seana 


You can get the last five lines with: 


tail -n5 [TEXTFILE] 


TABLE 1: SHELL TOOLS FOR TEXT EDITING 


Program Task 


tail -5 CTEXTFILE] 
Joell Ea Ne eee 


For the tail command, there is yet an- 
other interesting option. You can show 
the ongoing changes to a file using -f 
(follow), which is especially useful for 
log files. You can also set the sleep inter- 
val between readings (Figure 2). Press- 
ing Ctrl+C ends the output. 

Both programs also let you output spe- 
cific lines that aren’t tagged with a line 
number. For example, you can do: 


tail -3 [TEXTFILE] | head -1 


to output just the third line from the 
end. 


SUBSTRING 
EXTRACTION 

In most cases, you 
would use the cut 
program in struc- 
tured text files by 


Action 


Number all lines 


Number nonblank lines only 


$ cat a.txt 
Bauer Anton 
Meier Manfred 


Mueller Sabine 

[Schmidt Rosi 

|$ cat -n a.txt 

Bauer Anton 
Meier Manfred 
Mueller Sabine 
Schmidt Rosi 


BONE 


Sil 
Figure 1: Using cat and tac, output of a text file 
as standard out. 


the line. Alternatively, you can output by 
byte or character order. With data fields 
you need to indicate the field separator. 
If it’s a special character (e.g., tab) you 
need to escape it with \. 

Table 4 describes the options. You can 
follow a field, byte, or character number 
with a minus sign (-) to indicate extract- 
ing everything from it to the end of the 


TABLE 2: OPTIONS FOR CAT 


extracting individ- 


Don't output empty contiguous blank lines | z 


ual data fields. 


The output is in 


b 
Si 
Mark end of lines with “$” l FẸ 
| Mark tabs with “1” T 


the order given in 


Create text files and merge them vertically 


Output text files in reverse order 


Output the upper (first) row(s) 


Output the lower (last) row(s) 


cut 


Output parts of rows (data fields, bytes, fixed points) 


awk 


Output parts of a line in a specified order, and more 


grep 


Search pipes and text files (various versions exist) 


Text display with search functions and editor calls 


Count characters, words, or lines 


Add numbering to lines and output 


Sort lines and output 


Suppress output of successive identical lines 


Search and replace 


Convert text to octal 


recode 


Convert character fonts 


expand, unexpand 


Convert spaces to tabs, or tabs to spaces 


paste 


Merge text file columns (horizontally 


| 


join 


Merge text files horizontally, suppress duplicate columns, honor matching index values only 
(otherwise, errors) 


Say | 


split 


Split text files into subfiles 


csplit 


Split text files into subfiles with predetermined split locations 


Wrap text 


Compare text files line by line 
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TABLE 3: OPTIONS FOR HEAD AND TAIL 


Action head tail ; [Note 


Indicate number of lines from the end -n[NUMBER] -n{ NUMBER] Use [NUMBERIK for kilobytes 
Bytes from the end -c [BYTES] -c{BYTES] Use [NUMBERIK for kilobytes 
Filename in the output -vV aN — - 

Show appended data as file grows l sf Not available for head 
Refresh interval | -s=[SECONDS] Used in combination -f 


This functionality could be interesting 
if you need to merge CSV files. You can 


TABLE 4: Cut OPTIONS 


| Action Š Note g RER set variables inside loops and extract 
Extract field(s) -f[FIELD(S)] Field values numerically increasing the data (e.g., letter greetings based on 
Bacon = C[CHARACTER] recipients). The calls take the following 
Extract bytes -C[BYTES] Field values numerically increasing somm: 
Field delimiter l -f$'[DELIMITER]* | Escape special characters with | awk '(OFS="[FIELD_DELIMITER"; print 2 
Don't use on lines with- | -s SCFIELD], $CFIELD] ...}* CTEXTFILE] 
out delimiters 
or, you can do: 
file. A minus sign between two values characters 5 through 8 from each line. 
indicates a range. Although awk is covered elsewhere in se. | awk '(OFS="[FIELD_DELIMITER"; 2 
Figure 3 shows how cut works. Inthe this issue, it’s worth mentioning here if print S$CFIELD], $CFIELD] ...)' ... 
first example, you can see how the sec- only to point out how awk and cut dif- 
ond field is extracted from the struc- fer. Unlike cut, you can use awk to ex- Figure 4 shows an example of how an 
tured line (the field delimiter is the tab tract columns of a structured text filein awk call would work within a pipe. The 
character). The second example extracts any order. field delimiter I have chosen is a tabu- 


TABLE 5: GREP OPTIONS 


Action 

SEARCH PATTERN AS... 

Extended regular expression =E 

Basic regular expression -G Default 

Advanced regular Perl expression ZR 

DETAILS OF THE SEARCH PATTERN AND RESULT 

Use search pattern -e [PATTERN] | Multiple values not available with -P, otherwise always 
Use patter from search pattern file -f [FILE] 

Ignore character case “ij 

Extract non-matching lines (inversion) -V 

Count of matching lines PAG With -v, count non-matching lines 
Color screen output --color 


Include line numbers -n 


No output (for shell scripts, use return values only) | -q 


INFORMATION ABOUT FILES 

Output only filename of match =I 

Output only filename of non-match ale 

Suppress prefixing filenames -h 

Print filenames of match -H Default 
Recursively read all files in a directory -R also -r 
EXTENDED TEXT OUTPUT 

Number of lines after match -A [NUMBER] 

Number of lines before match -B [NUMBER] 

Number of lines of output context -C [NUMBER] 
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TABLE 6: CHARACTER CLASSES 


Character Class Expression 


Alphabetic "CC:alpha:]]' 
Alphanumeric |'[[:alnum:]]' 
Digits ARE done 
Spaces "[L:space:]]' 
Hexadecimal 'CC:xdigit: 

Control Cire saa. 


Punctuation 


Lowercase 


:lower:] 


Uppercase [:upper:]] 
TABLE 7: GREP IN PRACTICE 
Action 

Search for word in text 


|grep 'CWORD]' [TEXTFILE] 


lator character (which is the default 
delimiter awk uses anyway). The two 
columns of the file will be reversed. 


SEARCHING WITH GREP 

With grep, you can search through text 
files or data streams in pipes. Numerous 
options are available in shell scripts or 
by direct calls. 

Table 5 shows a selection. The grep 
search patterns can also be regular ex- 
pressions (regex). Some of the examples 
may have multiple solutions! You can 
use special designations in search pat- 
terns for character classes (Table 6). 
Note the character classes in double 


Include one line before and after search 
term; add color highlighting 


Include line number for search term 


grep 


--color -Cl ‘[SEARCHTERM]' 
[TEXTFILE] 


[$ tail -f /var/log/messages ] 
2015 -04-30T00: 48:04.154085+02:00 rachel 
ot 
2015-04-30T01:00:02.005852+02:00 rachel q 
for user root by (uid=0 
2015-04-30T01:00;02,006918+02:00 rachel d 
for user root by (uid=0) 
2015 -04-30T01:00:02,018792+02:00 rachel ş 
ned for user root by (uid=0) 
2015 -04-30T01:00:02.178336+02:00 rachel 
[ -n "$MDADM_CHECK_DURATION" -a -x /usr. 
-continue --duration "$MDADM_CHECK_DURAT. 
2015-04-30T01:00:02.220294+02:00 rachel 
for user root 
2015-04-30T01:00:02.279938+02:00 rachel q 
for user root 
2015-04-30T01:00:02.298320+02:00 rachel ş 
sed for user root 

2015-04-30T01 : 0: .965866+02:00 rachel s| 
2015-04-30T01:09:44.966634+02:00 rachel ş 
E by paul(uid=1000) 


Figure 2: You can keep tabs on changes in a 
og file using tail -f. 


$ grep 'Mueller' a.txt 
RENE Sabine 


$ grep --color -C1 'Mueller' a.txt 
Meier Manfred 

Mueller Sabine 

Schmidt Rosi 


grep -n '[SEARCHTERM]' CTEXTFILE] 


$ grep -n 'Mueller' a.txt 
3:Mueller Sabine 
e 


Search multiple files, include filename 


grep '[SEARCHTERM]' CTEXTFILES] 


Show lines not in search pattern 


grep -v 


' [SEARCHTERM]' CTEXTFILE] 


RE 


$ grep 'Mueller' *.txt 
.txt:Mueller Sabine 
.txt:Mueller Car driver 
.txt:Mueller Sabine 
-txt:Mueller Sabine 
.txt:Mueller Sabine 
.txt:Mueller Sabine 


pocaow» 
m 


$ grep -v 'Mueller' a,txt 
Bauer Anton 

Meier Manfred 

Schmidt Rosi 


Ignore uppercase and lowercase 


grep -i 


"[SEARCHTERM]' [TEXTFILE] 


$ grep -i 'mUeLlEr' a.txt 
Mueller Sabine 
e 


Output filename instead of search loca- 
tion 


grep -1 


"CSEARCHTERM]'" [TEXTFILE] 


$ grep -l 'Mueller' *.txt 
txt 

«txt 

txt 

txt 

txt 

CI 


List files without matches 


grep -L '[SEARCHTERM]' CTEXTFILE] 


grep -L 'Car driver! *.txt 
txt 
«txt 
txt 


«txt 
= 


Output number of matches (with multi- 
ple files) 


Search term includes indicated charac- 
ter 


Exactly X times 


fo ae |. 


grep -c ‘[SEARCHTERM]' [TEXTFILES] 


grep -c 'Mueller' *.txt 
.txt:1 

.txt:1 

.txt:1 

.txt:2 

.txt:1 

= 


pooncpwplsoaonpw|rocoocp 


grep ‘CCHARACTER]' [TEXTFILE] 


THE SEARCH TERM INCLUDES THE CHARACTER... 


grep 'CCHARACTER]\{[NUMBER]\}' 
CTEXTFILE] 


$ grep '[1]' a.txt 
AEO Sabine 
k 


$ grep 'I\{2\}' a.txt 
Mueller Sabine 

$ grep "I\{3\}' a. txt 
es 


At least X times and at most Y times 


grep '[CHARACTER]\ 
{CNUMBER(min) J, [NUMBER(max) ]\} ° 
CTEXTFILE] 


$ grep '1\{2,3\}' a.txt 
Mueller Sabine 
< 
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$ cat a.txt 
lAnton 
Manfred 
Sabine 
Rosi 

$ cat a.txt| cut -c5-8 
r An 

r Ma 

ler 

lidt 


SE 


Figure 3: Extracting data fields and characters 
using cut. 


[cut -d$"\t" -f2 


$ awk “{OFS="\t"; print $2, $1}" a.txt 
‘anton Bauer 

Manfred Meier 

Sabine Mueller 

Rosi Schmidt 

SE 


Figure 4: Extracting data fields using awk. 


brackets ('[[:alpha:]]'). You can basically 
use all options within a pipe, as long as 
they don’t relate to files or directories (-l 
and -L). 

For shell programming, the grep return 
values are important: 0 means found 
and 1 means an error; other errors are 
acknowledged with exit code 2. For test- 
ing purposes and as a short experimental 
platform, you can use the searchwith- 
grep.sh script in Listing 1. You can can- 
cel the input using Ctrl+C. Figure 5 
shows the outcome for both, and Table 7 
shows some additional possibilities. 


Less 

A convenient program for scanning and 
searching is less. This goes for text files 
as well as in pipes. For example, you can 
do the following: 


TABLE 8: OPTIONS FOR LESS 


Option 
Help 


TABLE 9: NAVIGATING WITH LESS 


Direction Key 

Line below Down arrow, 
Enter, orj 

Page below PgDn or Space- 
bar 

End of document | End or G 

Beginning of docu- | <or 1G 

ment 

Page up PgUp orb 

Line above Up arrow, k, or y 

One space to right | Right arrow 

One space to left Left arrow 


less (TEXTFILE] 
or 
ve [less 


Table 8 shows the most important op- 
tions. How you eventually work with the 
program depends largely on the terminal 
characteristics, which is particularly true 
of navigation in text. You can quit the 
program using Ctrl+Q. 

To navigate around the files that you 
browse with most distributions, you can 
simply use the arrow keys or use the 
keys described in Table 9. 

If you're scanning through a text file 
with less, you can press v to open it in 
an editor. If you do so while less is work- 
ing on a pipe, an error message appears. 
Entering /[SEARCHTERM] will begin the 


Automatically exits at end-of-file 


Automatically exit when reaching end-of- 
file second time 


SE No indicator with 
short content! 


Forces opening non-regular files 


Indicates current position or percent into 
file 


Indicates current location 
Includes line numbers 


With pipes, stores indicated content in a 
file, with overwrite confirmation 


-0 [FILENAME] 


Like -o, but with nonconfirmed overwrite 
Uses search pattern 


-0 [FILENAME] 
-p [PATTERN] 


Consolidates multiple blank lines 


a: 


Cuts off (rather than wraps) lines longer 
than screen width 


SSS 
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TABLE 10: OPTIONS FOR WC 


Element 
Words -W 


Bytes u 
Characters -m 


Lines 1 
Characters in the longest line | -L 


AB OPTIO OR 


tio Optio 


First line number | -v [NUMBER] 

on page 

Line number incre- | -i [NUMBER] 

ment 

Style for body -b[STYLE] 

numbering 

NUMBERING APPLIES TO... 

No numbering n 

Only nonempty 

lines 

All lines a 

Its format -n FORMAT J 
[Catim oo IOUS a] 

NUMBERING FORMAT... 

Left-justified In 

Right-justified rn 

Right-justified with | rz 

leading zeros 


search. The results are highlighted in re- 
verse video on the screen. 


STATISTICS WITH WC 
The wc command is interesting if you 
need to pay particular attention to char- 
acters, words, or lines. For example, you 
can use wc to provide parameters to pre- 
pare for printing. The wc command can 
be applied directly to files or can be 
piped. Table 10 shows the main options. 
The GNU version of wc described here 
provides, among other things, the option 
to extract the number of characters in 
the longest line of the document. You 
can use this information to create an at- 
tractive print output for encscript or 
latex, because this is an important factor 
in the choice of font size or page orienta- 
tion. Running the program without op- 
tions gives you the line, word, or byte 
count. Figure 6 provides some examples. 


NUMBERING LINES 
You can impose line numbering for 
(print) output independently of an edit- 
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ing (or other) ap- 
plication. The nl 
program works 
with text files and 
pipes. Table 11 
lists the options. 
For example, 
you would do the 
following: 


cat e.txt | nl v 2 
10 -i10 -ba -w 2? 
3 -nrz 


to number all lines 
in the piped data 
with a starting 
value of 10 and an 
increment of 10, 
making the num- 
bers three charac- 
ters (000) wide. 


SORTING FILES 
You often might 
need the sort func- 
tion to sort out 
multiple identical 
lines from a pipe. 
Of course, sort also 
serves for all other 
sorting tasks. 
Table 12 gives a 


$ sh searchwithgrep.sh 
Enter search term: Maier 
No match! 


Enter search term: Mueller 


TABLE 12: SORT OPTIONS 


= tESEPARATOR] 


Search term found. Sorting 
Enter search term: M 
Reverse 
> x By month 
Figure 5: Output of searchwithgrep.sh. y - 
Numeric 
$ wc a.txt 
OCEANE IIE Readable number values 
$wc -l a.txt : Fi 
rart Ignoring leading blanks 
$ we -w a.txt : 
a a.txt Ignoring case 
easy exe Based on field separators 
earners ees Unique only 
$ we -L a, txt 
15 a.txt 


Figure 6: Examples of wc. 


LISTING 1: SEARCHWITHGREP.SH Aptian 

ESEA N EN Ignore case 

01 #! /bin/sh 

02 while true: Print only duplicate lines 
03 do Print only unique lines 


04 echo -n “Enter search term: ";read 
search_term 


Compare no more than NUM characters in lines 


TABLE 13: OPTIONS FOR UNIQ 


05 cat a.txt | grep -q $search_term 
06 return_value=$(echo $?) 
07 if [ $return_value -eq 0 1; 


08 then 

09 echo "Search term Found." TABLE 14: OPTIONS FOR JOIN 

ee $return_value -eq 1 ]: FAT 

12 echo ‘No match!" Print unpairable lines from the first (1) | -al1|2] 

as or second (2) file 

14 done Ignore case l =| 
Join on this field of file 1 -1 [FIELD] 
Join on this field of file 2 -2 [FIELD] 


Avoid comparing the first NUM characters 


quick overview of the sort functions. 
Note that it’s not just about forward 
and backward sorting, but also about 
what is being sorted. 

The following command: 


cat *.txt | sort 2 
| unig -de 


Do not check if correctly sorted 


Treat the first line of each file as a field 
header and don't try to pair 


Next, you can ex- 
tract only the 


--nocheck-order 
~-header 


cat *.txt | sort -u 


unique lines from the data sources: 


cat *.txt | sort | uniq -u 


place patterns through character 
ranges in the form /CHARI-CHAR2]. 
The substitution is one to one, but you 


outputs all items in a folder, with multi- 
ple occurrences of identical lines sup- 
pressed. 


cat *.txt | sort | uniq 


REMOVING IDENTICAL LINES 

In overflowing log files with tons of 
consecutive identical messages, the 
unig command helps provide clarity. 
However, it can also be used when 
searching for duplicates. To handle du- 
plicates, the input or piped data needs 
to be sorted. Table 13 includes a few of 
the most important options. 

In the first example that follows, you 
can concatenate all the text files, sort 
them together, and output only the du- 
plicate lines prefixed with their occur- 
rence count: 


CHARACTERS 
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And, in this example: 


all duplicates are removed from the 
pipe output and both the unique and 
duplicate lines are displayed. 


SUBSTITUTING AND DELETING 


can have one substitution for multiple 
searches and vice versa. 

Special characters are escaped with \ 
for evaluation. Most often, you would 
use the form feed (\f), new line (\n), or 
horizontal tab escape (\t) sequence. 
The manual also includes further op- 
tions. 

The examples in Figure 7 show the 
following action: 

e Substitution of tabs with the | sym- 


Using the tr command, you can substi- bol. 
tute or delete (single) characters in a 
pipe. You delete using the -d option. 
You can also replace consecutive iden- 
tical characters with just one using -s. 
Character classes can also be used. As 
with sed, you can set search and re- 


© Replacement of all characters with 
uppercase. 

e Replacement of all u characters with 
their German umlaut equivalents. 

è Character deletion 

You can set the search and replace en- 
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tries as variables. Listing 2 shows a 
short shell script that uses variables in- 
stead of fixed patterns. 


Octat FORMAT 

You can use od to dump a file or output 
of a pipe into octal or some other for- 
mat. The program can help track down 
(not always reproducible) special char- 
acters. Without options, the output is in 
octal bytes. 

Using the -c option, the output ex- 
tracts into ASCII, with special and con- 
trol characters indicated. Using -x, it 
shows the information in hexadecimal. 


CONVERTING CHARACTER SETS 

Various character sets have existed for a 
while, making data exchanges difficult 
at times. With the recode program, you 
can convert the text file to a desired 
character set. Probably the most impor- 
tant option is -l, which lists all the 


om Waly dU 2 SE | 


$ paste a.txt c.txt 

Bauer Anton Meier Manfred 
Meier Manfred Bauer Antonius 
Mueller Sabine Mueller Sabine 


$ cat a.txt | tr \\t \| 
Bauer |Anton 
Meier|Manfred 

Mueller |Sabine 

Schmidt |Rosi 

$ cat a.txt | tr \u[:lower:] \[:upper:] 
BAUER ANTON 

MEIER MANFRED 
MUELLER SABINE 

SCHMIDT ROSI 

$ cat a.txt | tr \u \ü 
Baler Anton 

Meier Manfred 
Müeller Sabine 
Schmidt Rosi 

$ cat a.txt | tr -d \a 
Buer Anton 

Meier Mnfred 
Mueller Sbine 

Schmidt Rosi 

EE | 


Figure 7: Different uses of the tr tool. 


LISTING 2: SCRIPT USING TR 
01 #! /bin/sh 


02 echo -n " Search: ";read search_term 
03 echo -n “Replace with: “read erbe 


04 cat a.txt | tr "$search_term' “Serbe” 


TABLE 15: SPLIT OPTIONS 
Action 
OUTPUT FILES 


[Schmidt Rosi Schmidt Rosi 
$0 


Figure 8: Text files combined as columns using 
paste. 


known source and destination character 
sets. With -f, you can force recodings 
under all circumstances and the process 
is irreversible. The -v option provides a 
verbose summary of the conversion 
process itself. 

Further options are described on the 
manual web page. 

The smart method is to copy the file 
to be converted and avoid using the 
original. The recode -l command will get 
you the character set information. You 
can then apply the conversion to the 
copied file. 

The syntax is as follows: 


recode [OLD_CHARACTER SET). . (NEW 
CHARACTER_SET] [FILENAME] 


Necessary control characters are also 
added, such as CR or LF. As an example, 
you would do the following: 


cp a.txt exported. txt 
recode -v UTF-8.,1S0-8859-15 export. txt 


to convert a file from its original UTF-8 
character set to ISO-8859-15. 


REPLACING TABS 
The expand and unexpand programs 
adapting tabs within texts (in files as 
well as pipes). Both use the -t/NUM] op- 
tion that determines how many space 
characters to substitute for a tab (nor- 
mally eight). 

With unexpand, you can use the -a 
option to convert all spaces (not just 


| Filename extension length 


-a [LENGTH] 


Default: 2 


join a.txt b.txt 

uer Anton Car driver 
leier Manfred Train rider 
lueller Sabine Car driver 
join -al a.txt b.txt 
auer Anton Car driver 
leier Manfred Train rider 
ueller Sabine Car driver 
schmidt Rosi 

join --nocheck-order -1 2 -2 2 a.txt c.txt 
lanfred Meier Meier 

abine Mueller Mueller 
osi Schmidt Schmidt 


Figure 9: Joining text files using join. 


the first one) into tab characters. Note 
that using tr has pretty much the same 
effect. 


COMBINING TEXTS 

You use the paste tool for this. Each text 
file is considered a “column” in the tar- 
get file. The “montage” works as fol- 
lows: 


paste [FILE] [FILE2] 


You can, of course, direct the output to a 
new file. 

The tool does not in any way evaluate 
what is on each line. It just pairs them 
up. Figure 8 shows an example. 


JOINING Two FILES 

With the join command, you join the 
rows of two tables using a common key. 
The two tables need to be sorted first. 
To gain a better understanding of how 
this works, you can take a look at some 
of the sample files first. The format of 
the command is join [-OPTION] [FILE1] 
[FILE2]. 

Table 14 shows the most important 
options. If you omit any field values, 
the first column of the file is used by 
default. 

Figure 9 shows how join works. In 
the first example, without any options, 
the first field is the common key. In the 
second example, all non-joinable lines 
in the first file are printed to the output. 
Finally, all incorrect sorting error mes- 
sages are removed and the columns for 
joining get printed. Of course, any fur- 


LISTING 3: H.TXT 


Use numeric and not alphabetic | -d 
extension 


Number of lines 


~T ENUM 


| Size of file in bytes 


-b[BYTES] 


Number of partial files -n 


Not to be combined with 
-bor -I 
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0l --- 
02 Bauer 
03 --- 
04 Meier 
05 --- 
06 Mueller Sabine 
07 --- 

08 Schmidt Rosi 


Anton 


Manfred 
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REAL SOLUTIONS 
FOR REAL NETWORKS 


nfSense OpenShift 


CUT Climb into the Red Hat Cloud 


OpenShift 
Get started with Red Hat's 
easy and powerful PaaS cloud 


CUMULUS LINUX 


This specialty distro 
runs on switches - and 
supports provisioning 


Watchman 
Watch files for changes 


| JBoss Data Vintializauon 
| A uniform interface for all 


data - regardless of the source ae 
| Kali Linux 
Cool security 
FreeNAS and AD tool collection 
Integrate your storage i 


solution with Active Directory 


nix © Solaris 


ipts 


NSRI 
ewmedia. .com 


Each issue delivers 
technical solutions 
to the real-world 

problems you face 
every day. 


Learn the latest 
techniques for better: 


e network security 

e system management 
e troubleshooting 

e performance tuning 
e virtualization 

e cloud computing 

on Windows, Linux, 


Solaris, and popular 
varieties of Unix. 


SE RE 


HOME AUTOMATION 


Lights, cameras, appliances ... d 
control and monitor up to B” 


g fantastic 
at Dt 


Angst in the Astral Plane 


Did you miss a previous issue? 
To order a back issue visit our shop: 
shop.linuxnewmedia.com 


For a limited time only! 
Order issues #4, #5, and #6 of 
Raspberry Pi Geek for only USS 30*! 


* £14.99 / € 23.99 / $ 33.50 rest of world | 


Gimme My 
Raspberry Pi 
Geek! 


> shop.linuxnewmedia.com 


o FEATURES Swe TEXT 


Toots 


ther possible pairings are omitted due 
to any sorting errors. 


SPLITTING FILES 

The split command is used to split large 
files into manageable pieces to fit on 
smaller media. You can store split docu- 
ments in different places to make it 
harder for someone to assemble them 
for nefarious reasons. You can always 
reassemble the files using cat. 

Table 15 lists the most important op- 
tions. The size values you can give in 
bytes (without further additions), kilo- 
bytes (K), megabytes (M), or gigabytes 
(G). In most cases, you would use a 
filename prefix. The command has the 
form split [-OPTION] [FILE] [PREFIX]. 
You would use a dash symbol instead of 
the filename in a pipe. 

I’ll show three examples. After each 
example, you can check out the result 
by using cat on the files that begin with 
Part.* in your work directory. 

First, divide a file into a predeter- 
mined number of subfiles using 


split -n2 a.txt "Part," 


Note the dot at the end of the prefix 
value. You can use a pipe and specify a 
file size for splitting the file as follows: 


cat a.txt | split -b20 - "Part." 


The next example shows how to split a 
file line by line, which can help in struc- 
turing files for extracting addresses 
(roughly the same as using head and 


TABLE 16: OPTIONS FOR CSPLIT 


Action. Option 
Remove empty output -Zz 

files 

Add a file prefix -f£ PREFIX] 


TABLE 17: OPTIONS FOR DIFF 


Action 
Indicate that files differ, but no other details 


[$ diff a.txt c.txt 
140 

< Bauer Anton 

2a2 

> Bauer Antonius 

$ diff -y a.txt c.txt 
(Bauer Anton 

Meier Manfred 


Mueller Sabine 

[Schmidt Rosi 

|$ diff -q a.txt c.txt 

Files a.txt and c.txt differ 
|$ echo $? 


1 
SE 


< 
Meier Manfred 

> Bauer Antonius 
Mueller Sabine 
Schmidt Rosi 


Figure 10: Determining file content differences using diff. 


tail). In the case of split, numeric entries 
are required: 


split -d -12 a.txt "Part." 


In some ways, the csplit instruction is 
similar to cut, except that it splits a file 
vertically based on patterns. You should 
already be familiar with some of the op- 
tions shown in Table 16. 

The pattern is expressed as /.../. The 
file is split on the first occurrence of the 
pattern. You can also provide a number 
or {*} for “repeat the pattern as many 
times as possible” to generate the sub- 
files. The usual rules apply to the search 
patterns as far as escaping the shell spe- 
cial characters. If using a pipe, be sure to 
enter a dash instead of the filename. 

To see how this works, you can copy 
the a.txt to h.txt and add three dashes at 
the beginning of each line, as shown in 
Listing 3. This is the separator in csplit 
for creating subfiles. 

Next, create the subfiles from h.txt. 


csplit h.txt -z -f "Part," /---/ {*} 


Check the result by using cat on the files 
that begin with Part. * in your work di- 
rectory. 


WRAPPING TEXT 

If you want to wrap long lines of text in 
a controlled way, 
you can use the 
very handy fold 
command and its 


a options: 
Use side-by-side output format -y 
| Indicate only that the files are identical 3 fold -sbw[COLUMNS] 2 
Ignore case zil [FILE] 
Ignore tabs HE, 
Ignore changes in whitespace -b poulcan alsoe 
i whit z the fold program 
gnore all whitespace w ie in 
Ignore blank lines -B 


which case you 


36 ISSUE 25 


would omit the filename. The -b option 
indicates the bytes instead of columns, 
which prevents surprises involving con- 
trol characters. To prevent breaking up 
words, you can use -s to break at spaces 
only. Use -w[NUM] to indicate the num- 
ber of columns different from the de- 
fault 80. 

It’s not advisable, however, to use 
fold as a cut substitute if you want to 
split lines by fields. With addresses, for 
example, house numbers and street 
names commonly end up on different 
lines. 


LINE-BY-LINE COMPARISONS 
With diff you can determine content dif- 
ferences between files. Table 17 shows 
some of the options. You can also use 
the program to verify identical files. 
Some of the functions are similar to 
those for join. The exit code for identical 
documents is 0. If the documents are 
different, the tool will exit with 1. 
Compare the a.txt and c.txt files, for 
example. Figure 10 shows some of the 
possible options you can use. The first 
example shows the differences one at a 
time. The 1d0 entry and others are edi- 
tor commands that I won’t be covering 
here. The second example shows the re- 
sults in columns. The third example 
shows the “silent” execution and exit 
codes. 


CONCLUSION 

Many shell helpers can supplement or 
replace sed, and they can help you au- 
tomate many of the text-processing 
tasks you need to perform. e 


INFO 
[1] Files used in this article: ftp://ftp. 
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Awk as tool and scripting language 


TEXT MASTER 


BY STEFAN LAGOTZKI 


warangkana aa 0 123REcom 


wk is a scripting language spe- 

cially conceived for editing and 

evaluating text files, and it pro- 

vides a very useful tool for sys- 
tem administrators. 

With its help, for example, a modified 
data path can be integrated system-wide 
in a single step. Many more possible ap- 
plications exist, however, including eval- 


uating text files with data recorded in 
tabular format. 

An Awk script consists of single com- 
mands or command blocks that are exe- 
cuted under certain conditions or for all 
input rows. You can call the Awk com- 
mands directly from the command line or 
save them in a file as a script. You can 
find all sample data for this article online 
[1]. To try the examples, unpack the ar- 
chive into an empty directory. The ar- 
chive will include all the files for your ex- 
ercises. Some examples include Linux 
commands along with Awk commands. 

The first example uses the $USER sys- 
tem variable and takes you on a little 
tour of potential Awk applications: 


$ echo $USER | 2 
awk ‘{print "Hello * $1 "!")" 


Awk takes the content of $USER as a com- 
mand parameter. In processing the input, 
Awk stores all data fields in the variables 
$1 through $NF. The NF variable contains 
the number of data fields. Awk extracts the 
first command parameter from standard 
output and uses it with print and the word 
“Hello” to output the message to its own 
standard output. Multiple commands exe- 
cuted in succession are separated by a 
semicolon. To output only the third and 
fourth field of an input row, use: 


$ echo "ABCD" | 2 
awk ‘(print $3." " $4)" 
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Ipaul@rachel:-> cal 05 2015 | awk '{print NR" | " NF" | " $o}' j 


Figure 1: Awk can handle multiple-row input and separate data into fields. 


Of course, a tool like Awk can also han- 
dle multiple-row input. Pll show the cal 
Unix program, which prints out a calen- 
dar month to the terminal, for example. 
Take a look at Figure 1. Awk prints the 
row number (NR), the number of fields 
(NF), and then the whole row ($0) as a 
control. The fields in this first example 
are separated by spaces or tabs. Later, 
Pll show how to use other separators. 
Awk can use many other variables 
apart from NF and NR when interpreting 
input and controlling the output. The 
Awk manual [2] includes an entire sum- 
mary, as does the program’s man page. 
Using the -dump-variables option, you 
can save the important variables from an 
Awk command in a file for later use. 


ANALYZING FILES 

Most practical applications read data 
from files and process it row by row, 
often reading from multiple files simulta- 
neously. The awk '{print}' /etc/group 
command returns all rows in the /etc/ 
group file, which contains rows with the 
data fields Group_name, Group_pass- 
word, Group_ID and User_list (all the 
users in the group). 

In this case, the data fields are sepa- 
rated by colons instead of spaces or tabs. 
In reading group names or other data 
fields, you must use the field separator 
variable (FS), as in the following: 


$ awk -F':' ‘print $1)" /etc/group 


You can also use Posix character classes 
or regular expressions as separators. If 
you have a file with fields separated by 
commas, tabs or spaces, for example, 
use the following command: 


$ awk -F'L,C:blank:]]' 2 
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"(print $1 $2 $3)" data2.txt 


With Awk, you can change the order of 
the fields on output. If you want to out- 
put the ID first, then the group name and 
the users, you can do so as follows: 


Sei) Dias 
" $4]' /etc/group 


$ awk -F':' "(print $3 ” 


The print command is suitable only for 
formatted output. You can get a more 
comprehensive display of data with the 
printf() command that works as in C. 
Formatting options for numbers and 
character strings are described in detail 
in the Awk manual [2]. The following 
command formats the ID and user list: 
$ awk -F':' ‘{printf("45s %s\n",2 
$3,$4))" /etc/group 


You will often want to exclude certain 
fields from the output. You can do this 
by assigning a null string to the field, as 
follows: 


$ awk -F':' '{$2=""; print}' /etc/group 


The output of this example no longer 
has the fields separated by colons, be- 
cause Awk knows the separator for the 
output as well as the input. You can set 
the output separator values with the OFS 
variable. 


PATTERNS AND PATTERN RANGES 

So far, you have applied all the Awk 
commands to all input rows. In most 
cases, only selected rows need to be pro- 
cessed. The following example looks for 
group names in the /etc/group file that 
have no members. The condition is that 
the last field of the data row must be 


empty, and only those rows are read. 


$ awk -F':' '$NFa=*" D 
{print $0}' /etc/group 


An Awk script consists of three main 
blocks: BEGIN, main, and END, with at 
least one block present. The main block 
includes pairs of conditions and actions, 
with the action blocks depending on the 
conditions applied on all rows of the file. 


conditionl | actionblocki | 


condition? { actionblock2 } 


The conditions are also called patterns in 
Awk. Patterns can consist of strings, reg- 
ular expressions, logical expressions, 
and ranges. For example, you can output 
all the groups that contain your user 
name with the following command: 


$ awk -F's' "/**$USER*'/ 2 
(print $1)" /etc/group 


Here the shell expands the content of the 
$USER system variable and uses it as a 
search pattern. Unlike in the previous 
examples, Awk searches only those rows 
that fit the pattern. 

Regular expressions are text patterns 
used in Perl, Awk, and many other pro- 
grams and programming languages. You 
can find an introduction to regular ex- 
pressions in the fifth edition of our Linux 
Shell Handbook [3], and a standard ref- 
erence is Jeffrey Friedl’s book [4]. 

Awk uses regular expressions as 
search patterns in the format 
/<regex >/. To search for all groups be- 
ginning with the word post in /etc/group, 
use the following command: 


awk -F':' ‘/Apost/ (print $1)" /etc/group 


You can combine multiple regular ex- 
pressions as search patterns by using the 
logical operators && (logical AND) and 
|| Gogical OR). The following command 
finds all rows beginning with root or 
post: 

awk -F':' '/*post/ || /*root/ 2 
(print $1)" /etc/group 


Using the combination /‘ABC'/ && / 
DEF$/, you can find all rows in a file that 
begin with ABC and end with DEF. You 
can define pattern ranges with beginning 
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and ending conditions separated by a 
comma. The following two commands 
search rows 5 through 7 and then all 
groups from root through lp in the /etc/ 
group input file: 


$ awk -F':' "NR==5,NR==7 2 
{print $0)' /etc/group 

$ awk -F':' !/root/,/1p/ 2 
{print $1)" /etc/group 


Pattern ranges are useful for processing 
data beginning with a certain expression 
and ending with others. Awk processes 
only the data rows determined by the 
pattern range and ignores all others. An- 
other use of pattern ranges is when data 
is in blocks of rows separated by spaces. 
The following pattern range handles this 
condition: 


awk '/main_criteria/,/*$/ [actions] 


The range begins with a main criteria 
and ends with a blank row. The end 
condition uses the usual regular expres- 
sion of the caret (^), which translates to 
“the beginning of the row,” followed by 
the dollar sign ($), which translates to 
“the end of a row.” The beginning of a 
row followed immediately by the end of 
a row, with no characters in between 
means “look for an empty row.” 


BUILT-IN FUNCTIONS 

Awk has many useful functions that ex- 
pand upon those already mentioned. 
The most important can be used to pro- 
cess text strings. You can concatenate, 
split up, search through, and replace 
text strings as you wish. Figure 2 shows 
a few of these functions, which are also 
included in the stringfunctions.sh files. 


LISTING 1: USING GETLINE WITH AWK 


You can copy the examples into shell 
and experiment with the functions be- 
fore implementing them later in scripts. 

Another useful function is getline, 
with which the output of a called Unix 
command can be piped in as an Awk 
variable (see the systemcalls.awk exam- 
ple in Listing 1). Using getline, you can 
also read data from files instead of di- 
rectly from the command line. In this 
way, Awk can access data for formatting 
or comparing, for example. 


BEGIN AND END 
Along with the conditions previously 
mentioned, you have the special pat- 
terns BEGIN and END. These instruction 
blocks serve an important purpose in 
evaluating files. Awk processes the 
commands in the BEGIN block before it 
reads in any data. The commands serve 
in initializing the script and setting vari- 
ables. For example, if you want to 
change the delimiters for input and out- 
put, you can include the OFS variable 
within the block. The BEGIN block can 
also be used to output table headers. 

The commands in the END block are 
parsed after reading the last row of data. 
They are often used 
to evaluate the input = 
data. For example, 
you can calculate 
sums and averages 
or add footnotes to 
output tables. 

If both blocks are 
in an Awk script, 
it’s often worth sav- 
ing the script in a 
separate file. You 
can create these 
files with a text edi- 


tor such as Emacs or Vi. Most editors 
provide syntax highlighting to help in 
pairing curly braces for Awk. 


INTERPRETING LOG FILES 

Many larger network printers and print 
servers log print jobs in a text file. Logs 
usually include the print job originators, 
page sizes and counts, and other free 
ormat data fields for such things as 
project cost centers and other informa- 
tion. Each row is a print job record. In 
Listing 2, you can see the table headers 
and some sample records from a print- 
log. txt file. 

The Awk scripts for processing these 
inds of files take up about six to eight 
ines, depending on the format. They are 
included in the examples you can down- 
oad from the Ubuntu User site. You can 
also copy Listing 3 into a text editor and 
save it as evall.awk. You can start by 
evaluating the total number of black- 
and-white or color printed pages. Each 
of the sums is handled by a variable. 

Invoke the script with awk -f evall. 
awk printlog.txt, which first loads the 
script file, then executes the commands 
in Awk on printlog.txt. The script starts 


Figure 2: Awk provides a series of useful functions for processing text 


01 # Integrating Unix command 


02 BEGIN | 
03 “date +%x" | getline day; 
04 “date +27" | getline time: 


strings. 


LISTING 3: PRINT LOG EVALUATION 1 


01 #Evaluating the number of printed pages 


05 printf("\nToday is %s and it is %s o'clock.\n". day, time): 


LISTING 2: SAMPLE PRINTLOG.TXT FILE 


02 NR==1 | 

03 next; 

04 } 

05 | 

06 sum_color+=$6; 


Document User 


C2.sxw LAGO pro4 DIN_A4 Normal 
prop.pdf LEHM pro3 DIN_A4 Normal 
offer.doc LOHN prol DIN_A4 Normal 


Device Format Medium col 


b/w costctr 07 sum_bwt=$7; 
10 pol 08 | 
09 END | 
10 pol 
10 print sum color * Printed in color"; 
0 P02 11 print sum_bw * Printed in B&W": 
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LISTING 4: PRINT LOG EVALUATION 2 


LISTING 6: AVERAGE.AWK 


01 # Evaluating the number of B&W printed pages 
02 # for a cost center 

03 NR==1 | 

04 next; 

05 ) 

06 (printer[$8]+=$7} 

07 END { 

08 print "costctr. totals"; 

09 for (F in printer) (print F " " printer[F]} 
101 


by skipping a row if NR = = 1, which es- 
sentially ignores the table header row. It 
would also be possible to store this line 
in a variable and output it at the end. 

Awk increments the sum variables de- 
pending on number of color ($6) and 
B&W ($7) pages and prints both totals. 
Processing this print job for a cost center 
is a bit more complicated, but Awk can 
handle the task quite effectively (see 
Listing 4 and eval2.awk). 

Here again, the next command skips 
the first row. The remaining rows are to 
be evaluated to count the number of 
B&W pages for the cost center. The 
printer[$8] + =$7 command increments 
page counts in the printer{] array for the 
cost centers. Once all the datasets are 
read, the loop evaluates the printer data 
field in the END block and outputs the 
totals for each cost center. 

The printer[] array represents the 
names of the cost centers. In this arti- 
cle’s examples, you will also find the 
eval3.awk script, which sums up all the 
printings for each user by using two data 
fields. 


EVALUATING NUMBER VALUES 

The following example prepares some 
simple number values in a time column 
and five columns with floating point 
values (Listing 5). Because they are 
floating points, be sure to set the LC_ 
ALL =C variable in shell before you try 
this example. 

Listing 5 shows the table headers and 
the first few rows with sample data of 
the measureddata1.txt file. Calculating 
the average values is quite simple in 


LISTING 5: SAMPLE NUMBER VALUES 


01 # Averaging the values 


02 NR==1 [next:} 
03 (sum = 0; 


04 for (i=2; i<=NF; i+) I 


05 sumt+=$i; 
06 ) 


07 average = sum/(NF-1) 
08 printf("%6s %8.2f\n",$1,average); 


09 } 


LISTING 7: NUMBERVALUES1.AWK 


Awk through the 
average.awk script 


01 # Evaluating number values 


ee 02 BEGIN { print" t MIN MAX"); } 
in Listing 6. 03 NRe=1 ( next; 7 
You also often 04 | 
have to find the 05 t-0; neNF; 
minimum tad max 06  /* Store the number values in an array: */ 
+ 07 for (i=2; i<=n; i++) | 
imum values from a : A 
i S 08 yli-2] = $i; 
list. You can do this œ ] 
by sorting the rows 10) /* Sort the values: */ 
in a column. 11 for (i= 0; i <= n-2; i+) | 
Listing 7 shows 12 for (j = i; j > 0 88 ylj-1] > yE]; j--) | 
13 P= AL DEN JATE y EE A t 


the numbervalues1. 


s 14 } 
awk file that evalu- 


15 } 


ates the minimum 16 
and maximum val- 17 
ues, The numbers 18. printf(”\n"): 


are first stored in an 
array ($1 through 
$NF). After sorting, the first value has 
the minimum and the last value has the 
maximum. 

Sorting the values works through a 
cut-and-paste insertion sort method 
that is appropriate for limited number 
of values. You can find more efficient 
algorithms in Jon Bentley’s excellent 
book [5], for example. More compli- 
cated sorting algorithms require Awk 
functions. 


CONCLUSION 

Awk can address many everyday user or 
administrator tasks quickly and effort- 
lessly, and it is easier to learn than 
many other programming languages. 
This article covers the basics and pro- 
vides a few more complex examples. 
You can find support and countless 
other examples in news groups and on 
many websites. 


t Vall Va12 Val3 Val4 Va15 

0.100000 0.194000 0.166000 0.162000 0.155000 0.194200 

0.200000 0.440000 0.388000 0.359000 0.392000 0.400000 
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/* Output: t. MIN, MAX */ 
printf("%6s 28.6f %8,6f ",$1, y[0], y£n-2]); 


The free documentation [2] makes 
learning Awk easy and includes many 
more examples. The book by the three 
Awk inventors - Alfred Aho, Peter 
Weinberger, and Brian Kernighan [6] - 
is recommended for more advanced 
USETS.e 


INFO 


[1] Code examples from this article: 
ftp://ftp.linux-magazine.com/pub/ 
listings/ubuntu-user.com/25/AWK/ 

[2] Robbins, Arnold. The GNU Awk 
User's Guide 2003: http://www. 
gnu.org/software/gawk/manual/ 
gawk.html 


[3] “Regular Expressions” by Martin 
Streicher, Linux Shell Handbook 5: 
http//www.sparkhaus-shop.com/ 
eu/magazines/special-editions/ 
eh32040.html 

[4] Friedl, Jeffrey. Mastering Regular 
Expressions, O'Reilly, 2006. 


[5] Bentley, Jon. Programming Pearls, 
Addison-Wesley, 2000. 


[6] Aho, Kernighan, and Weinberger. 
The AWK Programming Lan- 
guage, Addison-Wesley, 1988. 
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Expect helps you develop automatic interactive scripts that respond to output from other 


command-line tools. 


Using Expect scripts to automate tasks 


GREAT EXPECTATIONS 


BY KEN HESS 


xpect is a natural and intuitive 
automation scripting language 
that operates in much the same 
way humans do when interacting 
with a system. You type in commands 
and expect a certain response to your 
command. When you receive the ex- 
pected response, you enter another com- 
mand and so on. Expect works in the 


same way, except you have to provide 
the script with commands and expected 
responses to those commands. Basically, 
you have to script out the entire two-way 
“conversation.” 

You can think of an Expect script as a 
dialog script written for two actors: a 
sender and a receiver. One of the more 
popular activities to automate is an SSH 
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Figure 1: Log in, print some info, and log out with your Expect script. 


session between two hosts, in which one 
host is the sender (local host) and the 
other is the receiver (remote host). Being 
able to emulate every keystroke and cre- 
ate a true interactive session between 
two systems via a script is an exciting 
proposition. 


EXPECT SETUP 

Most Linux distributions include Expect 
[1] as part of the available and install- 
able software packages. In other words, 
you won't have to download and install 
from source code. Use your system’s 
package manager to download and in- 
stall Expect and any required dependen- 
cies or associated packages. In Ubuntu, 
you would do: 


$ sudo apt-get install expect 


Once you have Expect installed, you can 
begin writing scripts. 


CREATING AN INTERACTIVE SSH 
SESSION 

As stated previously, you must provide 
both sides of the conversation in your 
script because you're setting up an inter- 
active system. Look at a few essential 
items before diving right into a script. 

To make an Expect script executable 
as a standalone program, you must do 
two things: Make the script executable 
and supply the path to the script for ex- 
pect. The path on my system is: /usr/ 
bin/expect; therefore, enter that path on 
the first line of your script with a preced- 
ing “shebang” (#!): 


#l/usr/bin/expect -f 


The -f switch tells Expect that it is read- 
ing commands from a file. 

The spawn command spawns or 
launches an external command for you. 
In this case, ssh to a remote host 
(SERVER): 


spawn ssh <SERVER> 


Change the host SERVER to your remote 
host. When you SSH to a remote system, 
you’re prompted for a password. This 
password prompt is what you “expect” 
from the remote system; therefore, you 
enter that expected response: 


expect “password: 


From the local side, you have to enter 
your password at the password prompt. 
To send anything to the remote sys- 

tem, it must be included in double 
quotes and must include a hard return 
(\r). Change PASSWORD to your pass- 
word: 


send "<PASSWORD>\r* 
Again, you have to enter the expected re- 
sponse from the remote system, which 
in this case is a user prompt ($ ). 

expect "$ r 
Now that you’re logged in to the remote 


system, you can begin your interactive 
session on that remote host. The follow- 
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ing send command issues the ps -ef |grep 
apache command: 


send “ps -ef |grep apache\r" 


Output will appear as STDOUT. After the 
command has executed, you’re returned 
to a prompt, so tell the Expect script that 
bit of information: 


expect *$ " 


Finally, send the exit command to the re- 
mote system to log out. Don’t forget that 
hard return (\r): 


send "exit\r" 


The script in its entirety looks like what 
you can see in Listing 1. 

Change permissions on the script so 
that it is executable using: 


$ chmod 755 script.sh 
and try running it (see Figure 1). 


Expect CAVEATS 

If your script hangs and doesn’t con- 
tinue, try the command manually your- 
self and look for the response. If the re- 
mote system drops you to a prompt as its 
final act, then place that in your script 
(e.g., expect "$ " ). 

Be sure you have entered the hard re- 
turn (\r) inside the closing quotation 
mark in your send line. You might also 
find that your system needs two back- 
slashes on the send line for a hard return 
(\r). Sometimes Expect scripts execute 
too fast, and you won't see your ex- 
pected response. If that happens, place a 
sleep command and a number of sec- 
onds for the command preceding it to 
wait for a response, or your data might 
be ignored. 


LISTING 1: LOGGING ONTO A REMOTE 
Host 


01 #1/usr/bin/expect -f 


0 


8 


spawn ssh SERVER 


0 


expect "password: 


04 send "PASSWORD\r" 


expect "$ " 


S 


send “ps -ef |grep apache\r" 


7 expect "$ * 


08 send "exit\r" 
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For example, if you connect to a re- 
mote system and there’s a delay in cre- 
ating that connection, your script will 
continue to execute and fail because it 
sends commands before the remote sys- 
tem has time to respond. 

You have to think about network de- 
lays, shell responses, and system timing 
when scripting in Expect. Like any 
scripting language, Expect has its 


quirks, but you'll find that it’s an easy 
way to automate those repetitious key- 
strokes and procedures. The time you 
spend debugging your scripts is well 
worth the effort. 


AUTOEXPECT 

Of course, some system administrators 
take lazy to a higher level and even 
cheat at writing Expect scripts by in- 


LISTING 2: AUTOEXPECT-GENERATED SCRIPT 


01 #!/usn/bin/expect -f 
02 # 


03 # This Expect script was generated by 
Autoexpect on Thu Oct 11 15:53:18 2012 


04 # Expect and Autoexpect were both written by 


Don Libes, NIST. 
05 # 


06 # Note that Autoexpect does not guarantee a 
working script. It 


o 


# necessarily has to guess about certain 
things. Two reasons a script 


o 
=) 


# might fail are: 
09 # 


S 


#1) timing - A surprising number of 
programs (rn, ksh, zsh, telnet, 


# etc.) and devices discard or ignore 
keystrokes that arrive "too 


# quickly" after prompts. 
new script hanging up at 


If you find your 


13 # one spot, try adding a short sleep just 
before the previous send. 


14 # Setting "force_conservative” to 1 (see 
below) makes Expect do this 


15 # automatically - pausing briefly before 
sending each character. This 


16 # pacifies every program I know of. The -c 
flag makes the script do 
17 # this in the first place. The -C flag 


allows you to define a 


18 # character to toggle this mode off and on. 


20 set force_conservative 0 ;# set to 1 to 
force conservative mode even if 


21 st script wasn’t run 


conservatively originally 


22 if ($force_conservative) { 


23 set send_slow {1 .1} 

24 proc send [ignore arg} { 
25 sleep .1 

26 exp_send -s -- $arg 
27 | 

28 ) 

29 

30 # 


31 # 2) differing output - Some programs 
produce different output each time 
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The "date" command is an 
Another is 


32 # they run. 
obvious example. 


33 # ftp, if it produces throughput statistics 
at the end of a file 

34 # transfer. 
delete these patterns or replace 


If this causes a problem, 


3: 


# them with wildcards. 
use the -p flag (for 


An alternative is to 


3 


S 


# “prompt") which makes Expect only look for 
the last line of output 


3 


s 


# (i.e., the prompt). The -P flag allows 
you to define a character to 


38 # toggle this mode off and on. 

39 # 

40 # Read the man page for more info. 
41 # 

42 # -Don 


44 set timeout -1 

45 spawn Senv(SHELL) 

46 match_max 100000 

47 expect -exact "]0;USER@HOST: ~USER@HOST:~\$ 


48 send -- “ssh SERVER\r" 

49 expect -exact "ssh SERVER\r 
50 USER@HOST's password: * 

51 send -- “PASSWORD\r" 


52 expect -exact “\r 


o 
a 


Linux SERVER 2,6,32-43-server #97-Ubuntu 
SMP Wed Sep 5 16:56:41 UTC 2012 x86_64 GNU/ 
Linux\r 


a 
= 


Ubuntu 10.04.4 LTS\r 
55 \r 
56 Welcome to the Ubuntu Server!\r 


57 * Documentation: 
server/doc\r 


58 \r 


59 System information as of Thu Oct 11 
15:55:28 CDT 2012\r 


http://www. ubuntu.com/ 


60 \r 


61 System loai 


1.09 


Temperature: 40 C\r 


62 Usage of /: 
Processes: 


1.0% of 454.2268 
168\r 


63 Memory usage: 22% Users 


eS PEEATURESO cee | 


voking a shell “watcher” or recorder 
script named Autoexpect [2]. 

Once invoked, Autoexpect watches 
your every keystroke and records it to a 
file named, script.exp by default. You’ll 
almost certainly have to edit and prune 
this script to achieve your desired re- 
sults; however, it can save hours of 
script debugging to have an almost 
complete script from which to work. If 


logged in: 1\r 


64 Swap usage: 0% IP address 


for eth0: 192.168.1.250\r 
65 \r 


66 Graph this data and manage this system at 
https://landscape.canonical.com/\r 


67 \r 

68 7 packages can be updated.\r 

69 7 updates are security updates.\r 
70 \r 

7 


New release ‘precise’ available.\r 

72 Run ‘do-release-upgrade’ to upgrade to it.\r 
73 \r 

74 *** System restart required ***\r 


7 


Last login: Thu Oct 11 15:53:41 2012 from 
HOST\r\r 


7 


a 


10; USER@HOST; -USER@HOST:-\$ " 
7 


send -- "ps -ef|grep apache\r" 
78 expect -exact "ps -ef|grep apache\r 


79 www-data 555 23171 0 Oct07 ? 


00:00:00 /usr/sbin/apache2 -k start\r 


80 www-data 556 23171 0 Oct07 ? 
00:00:00 /usr/sbin/apache2 -k start\r 


8 


www-data 557 23171 0 Oct07 ? 
00:00:00 /usr/sbin/apache2 -k start\r 


82 www-data 558 23171 0 Oct07 ? 
00:00:00 /usr/sbin/apache2 -k start\r 


83 www-data 559 23171 0 OctO7 ? 
00:00:00 /usr/sbin/apache2 -k start\r 


84 khess 21504 21433 0 15:55 pts/1 
00:00:00 grep apache\r 


85 root 23171 1 0 Sep27 ? 
00:00:28 /usr/sbin/apache2 -k start\r 


8 


S 


J0; USER@HOST: ~USER@HOST:~\$ " 
87 send -- “exit\r” 

88 expect -exact "exit\r 

89 logout\r 

90 Connection to SERVER closed.\r\r 


9: 


10; USER@HOST; ~USER@HOST:~\$ * 
92 send -- "^D" 
93 expect eof 


94 USER@HOST:~$ 
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LISTING 3: CLEANED Up AUTOEXPECT SCRIPT 


01 #!/usr/bin/expect -f 
02 


i# set to 1 to 
force conservative mode even if 


03 set force_conservative 0 


04 s# script wasn't run 
conservatively originally 


05 if [$force conservativel | 


06 set send_slow {1 .1} 
07 proc send {ignore arg) { 
08 sleep .1 


you simply run a freshly created Auto- 
expect script, it will likely fail because, 
if you issued a command that answers 
your request by displaying information 
to the screen, the script picks up that 
answer, too, and copies it into the 
script file. 

For example, if during your Autoex- 
pect session you type ls, the result of 
that command appears in your script. 
exp file as well. After you have created 
a few Expect scripts by hand, you will 
appreciate the cleanup editing that 
you have to do in an Autoexpect-cre- 
ated script. 

To install Autoexpect, issue a com- 
mand like: 


$ sudo apt-get install expect-dev 


You'll likely require many more depen- 
dencies for this feature, so prepare 
yourself for a slight delay while every- 
thing installs. 


CREATING AN INTERACTIVE SSH 
SESSION WITH AUTOEXPECT 
After installing Autoexpect and all of 
its required packages, you’re ready to 
create Expect scripts automatically by 
stepping through the procedures you 
want to automate. 

Using the above example, SSH to a 
remote system, run 


ps -ef |grep apache 


and then log out. 
Invoking Autoexpect is easy: 


$ Autoexpect 
Autoexpect started, file is script.exp 


$ 


Although it looks as if nothing has 


09 exp_send -s -- $arg 


12 

13 set timeout -1 

14 spawn $env(SHELL) 
15 match_max 100000 

16 expect -exact "$ * 


17 send -- "ssh SERVER\r" 


happened or is happening, every key- 
stroke you type will be recorded into 
script.exp. Every STDOUT response 
you receive will also be copied into 
that same file. 

Your entire session is recorded - but 
not just recorded, it is also formatted 
in Expect script style. To stop record- 
ing keystrokes to your script, press 
Ctrl+D on your keyboard to stop Auto- 
expect and copy the buffer to your file. 
The complete transcription of this sim- 
ple procedure is very long and in- 
cludes a lot of commentary from the 
author, Don Libes (Listing 2). 

You can see from the listing that you 
have a lot of cleanup to do before you 
distill this transcript down to its essen- 
tial parts. Autoexpect also changes 
permissions on the script.exp file so 
that it is executable. The parts you 
needed for this script to execute cor- 
rectly are shown in Listing 3 in my 
cleaned up version. 

You can see that the complex 
prompts, such as 


expect -exact “exit\r 

logout\r 

Connection to <SERVER> closed.\r\r 

10: <USER>@HOST>: 2 
~<USER>@CHOST> :~\$ " 


have been shortened significantly to: 
expect -exact "$ " 


The prompt still works because Ex- 
pect looks for the last few characters 
in an expect line and not the entire 
string. 

You could shorten the line that ex- 
pects the password prompt from: 


expect -exact "password: " 
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18 expect -exact “password: " 


19 send -- "PASSWORD\r" 


20 expect -exact "$ ” 


21 send -- “ps -ef|grep apache\r* 


22 expect -exact "$ ” 


23 send »- “exit\r” 


24 expect -exact "$ " 


to 


expect -exact ": 


A word of caution against shortening 
your Expect lines too much: It makes 
the script more difficult, not easier, to 
read and interpret in the future when 
you try to figure out what’s going on. 
You might not realize that ": "is a 
password prompt. Unless you’re great 
at including comments in your scripts, 
you might spend hours debugging this 
shortened version. 


CONCLUSION 

To be perfectly honest, I only use Au- 
toexpect when building an Expect 
draft script. To sit down and attempt 
writing an Expect script line by line 
just isn’t appealing after being se- 
duced and ruined by the ease of re- 
moving unwanted lines from an Auto- 
expect-created script [3]. 

Autoexpect makes using Expect fun 
and more intuitive by letting you per- 
form a procedure one time instead of 
many. After discovering and using Au- 
toexpect, my Expect scripting creation 
time and debug time has been cut by 
at least two-thirds. I suspect you’ll 
have much the same return on your 
time as well. e 


INFO 


[1] Expect: http//www.tcl.tk/man/ 
expect5.31/expect.1.html 

[2] Autoexpect: http:/www.tel.tk/ 
man/expect5.31/ 

[3] “How to Avoid Learning Expect” 
by Don Libes: http:/expect. 
sourceforge.net/doc/autoexpect. 
pdf 
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o KNOW HOW JigecOrrice TYPESETTING o ooo 


A documents design can make a lasting impression. We provide some tips to achieve a pleasing 


combination of fonts, color, and spacing. 


LibreOffice: Fonts, page color, and the magic number 


PRETTY PAGES 


BY BRUCE BYFIELD 


he fact that fonts define the look 

of a document is obvious. What 

may be less known is that fonts 

determine the structure as well. 
In fact, almost every important part of 
the layout is determined by your choice 
of fonts. That may seem like an exagger- 
ation, but it is true all the same. 

A document’s selection of fonts deter- 
mines the line spacing in the document, 
and line spacing is the main factor in a 
page’s color or the darkness of the text. 
Once you have the page color, the line 
spacing that provides it becomes the 


magic number for setting up the rest of a 
document's structure. 

However, before you can make such 
decisions, you need to know more 
about fonts in general, including where 
to get them, how they are classified, 
and how they work in LibreOffice in 
particular. 


FINDING FONTS 

Many users never venture beyond the 
fonts already installed on their comput- 
ers when they design documents. Noth- 
ing is wrong with that choice, but noth- 
ing is particularly right with it, either. 

By using fonts that everyone has seen 
many times, you greatly increase the 
chance of creating an impression of 
blandness. Popular fonts like Times 
Roman, Arial, or Helvetica can work 
against you, because they are so famil- 
iar that they encourage readers to pay 
less attention. 

Traditionally, additional computer 
fonts are designed for sale like any 
other software. Design houses like 
Adobe sell hundreds, including the offi- 
cial versions of well-known ones like 
Avenir and Gill Sans. 

For years, the only alternative to pay- 
ing for fonts was to use free or public 
domain fonts, many of which have a 
well-deserved reputation for low qual- 
ity. However, in the past decade, many 
free-licensed fonts have become avail- 
able. You can find hundreds of free 
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Character Style: Bullets 


woe for the entire sys- 
tem is the most 
| convenient, as- 


Liberation Serif ti 
I ibertv iS} 


Language [English (USA) 


iberation Sans Narrow. 


Él 


The same font will be used on both your printer and your screen. 


Apply Cancel Help Reset Standard 


suming that you 
have administra- 
tion privileges. 


WORKING WITH 
FONTS 

Fonts are set on 
the Font tab of a 
paragraph or char- 
acter style (Figure 
_ 1). On the Font 
tab, each font has 
three basic char- 
acteristics: its 


Figure 1: The Font tab of character and paragraph styles has the tools for 
working with fonts. 


fonts at Google Fonts [1] or the Open 
Font Library [2]. 


FONTS FOR LIBREOFFICE 

LibreOffice supports Postscript (.pfb), 
TrueType (.ttf), and OpenType (.otf) font 
file formats. Other font formats exist 
and are often still supported by Linux 
distributions, but these formats may be 
limited in selection and quality and are 
best avoided. 

You can install additional fonts 
through your operating system or place 
them in the /share/fonts folder in the 
system path listed at Tools | Options | 
Path to install them only for LibreOffice 
or OpenOffice. Usually, installing fonts 


family (known 

outside LibreOffice 

as the typeface), 
style, and size. Fonts can be further 
modified by features on the Font Effect 
tab, where formatting features such as 
the font color are set. 

Fonts can be classified in several ways, 
but the most common are by design 
characteristics. The main categories are: 
e Serif: Fonts whose lines end with a 

foot or a hook (Figure 2). A subcate- 

gory of serifs is called slab serif, which 
has very large serifs, making it suit- 
able for posters and online. 

e Sans Serif: Literally, fonts whose lines 
lack the foot or hook that character- 
izes serifs (Figure 3). Sans serif fonts 
often read well online. When the New 
Typography movement of the early 


Serif Slab 


twentieth century favored sans serif 
fonts as part of their general simplifi- 
cation of design, the fonts gained a 


reputation for modernity that they still 


keep today [3]. They are informally 
called “Sans.” 


e Monospaced: Fonts in which every let- 


ter occupies exactly the same amount 
of space (Figure 4). By contrast, in 
most fonts, letters take up different 


amounts of space, with i taking up the 


least, and m the most. Monospaced 
fonts can be either serif or sans serif, 
but the sans serif monospaced are 
usually better designed. Because they 
were once common on typewriters, 
monospaced fonts are unpopular 
today, except for specific uses such as 
writing code or movie scripts. 

Other categories include Decorative, 


Script, and Dingbats, but none are com- 


mon in text-heavy documents. 


FONT STYLES 

Different members of a font family are 
often called weights. This term refers to 
the thickness of the lines that make up 
the individual letters. In character and 
paragraph styles, LibreOffice refers to a 
weight as a font style. 

Using the term “font styles” makes 
sense, because weights are not always 
defined by thickness of line. An italic 
weight, for example, is defined by the 
text being both angled to the right and 
rounded. The most common font styles 
include the following: 


Roman 


Figure 2: Serif fonts have hooks at the end of letter strokes. 


ans Serif 


letter strokes that characterize serif fonts. 


Figure 3: Modern-looking sans serif fonts lack the hooks at the end of 


are simply angled. 


Monospaced 


Figure 4: In a monospaced font, each letter is the same width. 
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Figure 5: Roman font styles are the standard fonts. 


Italic Oblique 


Figure 6: Italic fonts are rounded and angled to the right. Oblique fonts 


Bold Heavy 


Figure 7: Bold font styles have heavy letter strokes. 
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Figure 8: Fonts size refers to the amount of 
space given to each letter. Because some fonts 
use different amounts of white space, they can 
look bigger or smaller than fonts of the same 
size. 


e Roman: This is the font style most 
often used for body text (Figure 5). It 
may also called Regular, Book, or Me- 
dium, although these are not always 
exact synonyms in individual font fami- 
lies. 

e Italic: A cursive font, slanted to the 
right, used mainly for emphasis and 
book titles (Figure 6). In modern fonts, 
the italic is sometimes replaced by an 
Oblique style, which is similar to 
Roman, only inclined to the right. 

è Bold: A version of the font with heavier 
lines on each character (Figure 7). Used 
for strong emphasis and headings, this 
weight sometimes replaces Italics on- 
line. Variants may have names like 
Black, Semi-Bold, Demi-bold, Extra, or 
Heavy, sometimes each with a different 
thickness of line. The thicker variations 
are usually intended for use at large 
font sizes in media such as posters. 

Another way to classify fonts has become 

popular thanks to the use of CSS style 

sheets on web page (Table 1). 


FONT Sizes 

Traditionally, fonts are measured in 
points, In the digital age, this measure- 
ment has been standardized as one-sev- 
enty-second of an inch or 2.5 centimeters. 
Previously, a point was actually slightly 
less, but it remains defiantly non-metric 
and a sign of typographic expertise. 


TABLE 1: CSS Font CLASSIFICATIONS 


Descriptive 
Extra Light 


Numeric 


Regular, Roman 
Medium 
Semi-Bold/Demi-bold 


Heavy, Extra, Black 
Ultra, Extra 
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When working with fonts, you should 
set LibreOffice’s default measurement 
unit to points from Tools | Options | Libre- 
Office Writer | General | Settings. Using 
points will make the design process much 
easier. You can always change the Mea- 
surement unit back to centimeters or 
inches when you start to add content. 

The font size refers to the amount of 
space given to each character and the 
empty space around it. However, how 
each font uses the empty space can vary 
tremendously. Each font uses a different 
amount of empty space, which explains 
why the actual height of fonts of the same 
size is inconsistent. In fact, the actual 
height can vary considerably (Figure 8). 

The standard size for body text is usu- 
ally 10-14 points. Text for captions and 
notes sometimes goes as low as 8 points, 
whereas headings and titles are rarely 
more than 28 points. If a font has a lot of 
white space around it, you might want to 
use it at a slightly larger size sometimes 
to compensate. 


Cyoosine Fonts 

Choosing a font begins with understand- 
ing the impression you want to make. 
For example, a commonly used font 
helps put readers in an accepting mood, 
whereas an unusual one might reinforce 
an impression of innovation. 

At times, a font might need to fit the 
constraints of the page. A tall, narrow 
page, for example, might be matched 
with a similarly tall and narrow font. Or 
maybe a font has some association with 
the content - for example, at least one 
edition of Arthur Conan Doyle’s The 
Hound of the Baskervilles was printed in 
Baskerville font. 

The main purpose of the body text is 
that it must be easily readable by your 
audience in the conditions in which they 
are likely to see it. For example, if you 
are designing a memo template for a 
low-resolution fax, you might prefer a 
larger, bold text style. Similarly, a bro- 
chure aimed at seniors might use a 
larger font size than usual. In other 
cases, you may be limited by a lower 
printer resolution or even a temporary 
shortage of toner to fonts with thick, 
consistent lines. 

Often, a key feature for body text is 
the x-height. This is just what it sounds 
like: the height of the lower case letter x, 
as well as lowercase letters such as r and 


m. As a rule, the higher the x-height, the 
more readable a font is likely to be. 

The heading font is used for anything 
that guides readers through the docu- 
ment, but is not actually content. It is 
used most obviously by the Headings 
1-10 styles in Writer. It can belong to the 
same font family as the body text, but, if 
so, it should be a different font style, 
size, or color. 


MATCHING FONTS 

Body and heading fonts should be com- 

patible, but different enough so that one 

cannot be mistaken for another. In most 
cases, you need only these two fonts; 
however, this is not as limiting as it 
sounds. Most fonts include at least four 
font styles - Roman, Italic, Bold, and 

Bold Italic. Some have as many as nine, 

and a few have even more. Using too 

many font styles in the same document 
can look just as cluttered as too many 
different fonts, but you can generally use 
several font styles together without dis- 
tracting from the document’s content. 

Matching fonts is an art form rather 
than a science, but you can increase the 
odds of finding fonts that go together by 
selecting ones that: 

+ Share the same font family. 

e Are designed by the same typographer. 

A designer’s preferences and habits 

may remain similar enough between 

fonts to give a common appearance. 

Come from the same era or are de- 

scribed in the same terms. Countless 

terms are used to categorize fonts his- 
torically, but even if you are uncertain 
how a Humanist font (one based on 

Renaissance designs) differs from a 

Geometric font (one based on simple 

shapes), you can safely guess that the 

two are unlikely to go together. Of 
course, the more you know about the 
history of typography, the more you 
can match fonts by their origins. 

e Have a large number of font styles, es- 
pecially if you plan to use the same 
font for both body text and headings. 

The only way to be sure that fonts 

match, however, is to experiment with 

them, both on-screen and by printing 
frequent hard copy samples. 

More general considerations in font se- 
lection can include: 

© Where will the document be used? The 
North American convention is to use a 
serif font (fonts with small hooks at the 
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Lorem ipsum dolor sit amet. conse 
ursus ante dapibus diam. Sed nisi 
psum. Praesent mauris. Fusce nec 
acinia arcu eget nulla. Class aptent 
nceptos himenaeos. Curabitur sodą 
Pellentesque nibh. Aenean quam. in 
ristique | _ | 

Figure 9: Too light a page color {using Raleway Light font). 


ad litora torquent per conubia nostra, pe 
inceptos himenaeos. Curabitur sodales 
ligula in libero. Sed dignissim lacinia 
nunc. Curabitur tortor. Pellentesque nibh 
Aenean quam. In scelerisque sem at 


dolor. Maecenas mattis. Sed convallis | 
Figure 10: Too dark a page color (Quattrocentro Roman). 


end of letter strokes) for body text, and 
a sans serif (fonts without the hooks) 
for headers. By contrast, in Europe, ty- 
pographers are much less likely to 
abide by this convention. You can use a 
sans serif for body text in North Amer- 
ica, but it may be perceived as an 
avant-garde choice. 

e Is the document for paper or online 
use? Even today, text on a screen is 
lower resolution than professional 
printing and may be processed differ- 
ently by the brain than words on a 
page. For online use, you want fonts to 
have regular shapes, with a minimal of 
tapering. Often, that means designing 
mainly with sans serifs and the occa- 
sional slab serif (a font with very large 
hooks at the end of letter strokes). 

e Will recipients have the fonts installed 
on their computers to display the docu- 
ment properly? If you only want recipi- 
ents to view the document, you can 
send a PDF file. Otherwise, you might 
be better off sticking to the standard 
Times New Roman, Arial, Helvetica, 
and Courier, or else the Liberation 
fonts, which are designed to take up 
the same space as the standard fonts. 
In recent versions of LibreOffice, you 
can also embed fonts in the document 
from Files | Properties | Font, but be 
aware that embedding just one font can 
significantly increase file size, to the 
point that some email accounts may 
bounce a file with embedded fonts. 


© Do you prefer to use only free-licensed 
fonts? If so, you will be unable to use 
some of the best-known fonts, although 
you can sometimes find substitutes [4]. 
However, free-licensed fonts are often 
cost-free. They also mean that recipi- 
ents only need an Internet connection 
to install the fonts they need. 

After you’ve chosen the fonts, you can 

turn your attention to the body font and 

page color it creates. 


Pace COLOR 

The page color in this context does not 
refer to whether the text is black or 
green, but to how dark or light a page 
looks. As you can see by opening profes- 
sionally published books, you want the 
body text to be neither too black or too 
washed out, but a consistent dark gray. 
Anything else is likely to make the docu- 
ment harder to read (Figures 9-11). 

By contrast, the color of headings is 
usually darker than the body text, so it 
stands out and is useful when readers are 
browsing. For the most part, you can ig- 
nore the color of headings and concen- 
trate on getting the right color for the 
body text. 

The single most important influence 
on color is line spacing. Line spacing is 
defined as the measurement from one 
baseline (the imaginary line that the bot- 
tom of a letter like n or m sits on) to the 
next one (Figure 12). In LibreOffice, line 
spacing is set in the Line Spacing field on 


the Indents & Spacing tab for paragraphs 
(Figure 13). 

In LibreOffice Writer, line spacing is 
averaged according to the font size. The 
exact measurement is displayed when 
you set the Line Spacing field to Fixed. 
LibreOffice sets a default line spacing 
based on the font size. For a 12-point 
font, that average is 14 points. However, 
because each font uses the space for 
characters differently, the default line 
spacing is not always ideal and may need 
to be adjusted by changing either the line 
spacing or the font size. 

In theory or desperation, you can also 
use Position | Scale width to alter the 
width of the font's letters, or Position | 
Spacing to adjust the space between let- 
ters. However, in both these fields, small 
changes can have large effects on the ap- 
pearance of a font. You need patience to 
use either field, and you may simply de- 
cide that any font that needs this careful 
attention should be discarded for another 
choice. 

Developing an eye for line spacing and 
page color takes practice, so you might 
want to begin by comparing your efforts 
to a published book that is pleasing to 
your eye. However, certain contexts are 
more likely to need adjustments in line 
spacing than others, as shown in Table 2. 

If you think that page color needs adjust- 
ing, experiment with dummy text of at 
least three lines, so that you can concen- 
trate on the page color rather than the con- 


Lorem ipsum dolor sic amet, consectetur adipiscing elit. Integer nec odio. Praesent libe 
nisi. Nulla quis sem at nibh elementum imperdiet. Duis sagittis ipsum. Praesent mauri: 
porta. Mauris massa. Vestibulum lacinia arcu eget nulla. Class aptent taciti sociosqu ad 
inceptos himenaeos. Curabitur sodales ligula in libero. Sed dignissim lacinia nunc. Cu 
Aenean quam. In scelerisque sem at dolor. Maecenas mattis. Sed convallis tristique 


Lorem ipsum dolor sit amer, consectetur adipiscing elit. Integer nec odio. Praesent libe: 
nisi. Nulla quis sem at nibh elementum imperdiet. Duis sagittis ipsum. Praesent mauris 
porta. Mauris massa. Vestibulum lacinia arcu eget nulla. Class aptent taciti sociosqu ad 

inceptos himenaeos. Curabitur sodales ligula in libero. Sed dignissim lacinia nunc. Cur: 
‘Aenean quam. In scelerisque sem at dolor. Maecenas mattis. Sed convallis tristique M 


Figure 11: A suitable page color (E.B. Garamond). 
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baseline Ipsum lorem 


line spacing | 
baie = Ipsumilorem 


Figure 12: The baseline is the imaginary line that letters sit upon. The 
space between two baselines is called the line spacing. 
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Before text: 


After text: pox H 
Prst ine: por H 
D Automatic 

Spacing 

Above paragraph: F.0 pt El 
Below paragraph: Pon f 


D Dont add space between paragraphs of the same style 
Line Spacing 


Hep | 


page color. 


tents. Often, dummy text is in a foreign 
language, which is why the fractured Latin 
that begins with “Lorem ipsum...” is often 
used. You can download copies of the 
Lorem Ipsum, as it is called, ranging from 
a few lines to several pages with a quick 
Internet search. 

Copy the dummy text several times on 
the same page. First, apply each possible 
choice for your body text to a copy and 
compare the results. The chances are no 
better than 50 percent that LibreOffice’s 
default line spacing will be ideal for a 
given font, so the next step is to make sev- 
eral copies of the dummy text that use 
your possible font, each with a different 
line spacing. Introduce changes in letter 
width or letter spacing only as a last resort. 

Make small but systematic changes, 
comparing them frequently, until you have 
a page color that satisfies you. Adjusting 
page color is as much an art as a science, 
but viewing your samples both online and 
on paper and, from up close and from 
about 150 centimeters away, and consult- 
ing friends can all help you develop a sense 
of what works. Sometimes, too, economics 


TABLE 2; WHEN TO INCREASE 0 


Increase 


Fonts whose characters are narrow or 
have smaller spaces between them. 


A line of text less than 45 characters. 


Font sizes of less than 10 points, or more 


than 14. 
Roman fonts that are too black. 


Most sans-serif fonts; italic or oblique 
fonts. 
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Figure 13: Set spacing to Fixed to adjust line spacing and to change 


enters the choice: 
Few hard copy pub- 
lishers are likely to 
agree to 18-point line 
spacing for a 12-point 
font, no matter how 
aesthetic the results, 
because the extra 
pages it requires 
would seriously add 
to the cost of paper. 
The Fixed line 
spacing - with or 
without letter width 
or letter spacing - 
that gives you a sat- 
isfactory page color 
is the magic number 
that will determine 
most of the rest of your design. Typogra- 
phers designate a layout with the font size 
followed by the line spacing, so that a 
paragraph designated as 11/14 has a font 
size of 11 points and a line spacing of 14. 


APPLYING THE MaGic NUMBER 
Beginning typographers often wonder how 
to proportion documents. Over the years, 
countless theories have evolved, many of 
them are uncomfortably elaborate. But the 
easiest is what I call - for want of a better 
name - the magic number. 

The magic number is the line spacing 
that gives the best page color for the cho- 
sen Body Text font and all the paragraph 
styles based on it. The magic number’s ap- 
plication is simple: Whenever possible, 
any measurement in a document will be a 
multiple of the selected line spacing. For 
example, if the magic number is 15, the in- 
dentation at the start of a new paragraph 
would also be 15 points. Similarly, the top 
page margin might be 60 points (4x15). 

Not every design element can use the 
magic number, but most of the important 
ones can, as follows: 


REASE LINE SPACING 


Decrease 

Fonts whose characters are broad or rela- 
tively large spaces between them. 

A line of text greater than about 80 char- 
acters. 

Fonts of 10-14 points. 


Regular fonts that are light gray. 


Some serif fonts. 


+ Text indents, first line indent, space 
above paragraph 

+ Space below paragraph, space between 
numbered, bullet, and list items, space 
above or below a graphic or any other 
inserted object 

e Tabs 

e Page margins, header/footer height, 
space between a header and footer and 
main text 

+ The combination of heading font size 
and the space above/below 

At times, you might use half the line 

spacing instead of a whole multiple. In 

theory, you could use a quarter of the line 

spacing or less. However, if you stop at 

half, then your document will never be 

far out of sync. Using the magic number 

is painstaking - but it is precise and un- 

ambiguous. You should have no trouble 

detecting a document designed with the 

magic number, because of its unified di- 

mensions. 


TYPOGRAPHY AND LIBREOFFICE 

If all this sounds like a lot of work - it is. 
Although modern computer users take 
fonts for granted, the tradition of how to 
use them has developed over more than 
five centuries. Many printers and publish- 
ers consider the selection and arrange- 
ment of fonts a minor art form, and well 
worth taking pains over. The advantage 
of using the magic number is that it adds 
a uniformity of design and reduces many 
design choices to a system. 

After all, if you place your thoughts in a 
pleasing form, the layout just might help 
to persuade your readers to your point of 
view - and think better of you as well. 

The rumor is that the developers at 
StarDivision, which became OpenOffice. 
org, were told that would have to use the 
code they wrote to document it, so they 
put all the features they would need into 
it. That may or may not be true, but free 
software is especially fortunate in Libre- 
Office and its predecessor OpenOffice.org 
in having a document processor that al- 
lows high standards of design. e 
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The plotutils package promises quick help to visualize numerical data in a variety of output 


formats. 


Creating informative graphs with plotutils 


GRAPHING 


BY KARSTEN GUNTHER 


n simple graph can help you vi- 

sualize complex data and be a 

very useful tool in presentations 

and reports. The plotutils pack- 
age [1] brings together a group of pro- 
grams that all access the functions of 
GNU Libplot. 

This library produces device-agnostic 
vector graphics and even animations in 
various output formats. There are bind- 
ings for C and C++ among other library 
classes. And, because of the effective in- 
terface programs for the shell, in most 
cases, you don’t need to program any- 
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= 
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3 


thing - it’s often enough to invoke a 
smartly crafted command line. 


INSTALLING PLOTUTILS 

The plotutils package is found in the 
major distribution repositories so that it 
can be set up easily with the corre- 
sponding package manager. In Ubuntu, 
you can just use the apt-get install plo- 
tutils command with administrative 
tights. This step pulls in all the neces- 
sary dependencies. 

You select the desired output format 
(Table 1) with the -T option as an argu- 
ment to the command, such as graph -T 
X ..., where plotutils accepts multiple in- 
stances of -T. You just need to supply a 
suitable output redirection: 

$ graph -T X -T PNG ... > output.png 
Several programs are used for graphics 
output. The main one is the graph pro- 
gram seen in the previous example. 
Using --help, you can display all the 
available options, which are surprisingly 
clear (see Table 2). 

The “plots” created with plotutils con- 
sist of the plotted curve, the X and Y axis 
with their labels, and other possible ele- 
ments such as a plot title and back- 
ground grid. 

Graph accepts binary and plaintext 
files, with the latter being significantly 
easier to handle in that you can easily 
create and modify them in a text editor. 
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Figure 1: Graph easily and quickly displays output in an X window. 


You can use additional Graph options to 
interpret the input data (Table 3). 

In creating the command lines, pay 
particular attention to the order of op- 
tions and arguments. The options con- 
trol the presentation of the data values 
that follow. Apart from the command- 
line options, Graph provides a set of en- 
vironmental variables, which the plo- 
tutils programs use as options. However, 
the command-line options override the 
environmental variables. 


LINE BY LINE 

Graph reads the input data from a file or 
standard in. The program expects the 
data as simple space-separated X/Y 


TABLE 1: PLOTUTILS FORMATS 


Format 
Adobe Illustrator 


Identifier 


FIG Editable vector graphics format for the Fig 


program 


Figure 2: Multiple plot curves are distinguished by different line types, 


even when they don't overlap. 


value pairs, one for each measurement. 
Listing 1 shows an example. Note the 
use of options as comments at the begin- 
ning, which can also occur in the data 
and determine how the data that follows 
is represented. 

Alternatively the input can occur in 
one piece instead of line by line, such as 
when reading from standard in, as in the 
following example: 


$ echo 11223111] graph -TX 


Graph reads in the values as coordinate 
pairs. You can also use the -a option to 
specify reading in the values as Y axis 
values only - more on this later. 
Another inter- 
pretation results 
when you use the 
-I e option to in- 
clude error bars in 
output, which are 
common in nor- 


Metafile 
used internally 


mat 


A simple version of GIF 
GNU device-independent graphic format 


PNG files, useful for further editing 


Portable Anymap, a universal bitmap for- 


PostScript, convertible to PDF 


mal measure- 
ments. In this 
case, Graph ex- 
pects data triplets 
(xy <error>), 
unless you enable 
-a again. 

You should first 


output file 


Classic scalable vector graphics format 


X window display format that creates no 


test the data out- 
put in an X win- 
dow (Figure 1). In 
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this case, you can specify X as the out- 
put device (graph -T X < data >) and the 
program will take care of things auto- 
matically. Pressing Q or clicking the win- 
dow closes it again. 


CURVES AND LINES 

If empty lines appear in the input, Graph 
interprets them as the start of a new plot 
and displays the plot correspondingly 
(Figure 2). The program behaves simi- 
larly when data is derived from multiple 
sources (as shown in the first line of the 
following example). To distinguish the 
two plots, give the second one a differ- 
ent color using the -C option as shown in 
the second line below: 


$ graph -TX /tmp/tst /tmp/tstl 
$ graph -TX -C /tmp/tst2 /tmp/tst3 


See Figure 3 for an example. 


AXIS AND SURFACES 

The -a option automatically labels the X 
axis and can process data with just Y- 
axis values. This helps when there are 
constant values or only one coordinate 


LISTING 1: SAMPLE INPUT 
#im=5 ,S=10 

1422968301 140736 

El 

11422973527 137436 
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Figure 3: The -C option adds color to plot curves. 


indicated. An example is described in 
the “Problems with Date Representa- 
tion” box. The -a option increments the 
X value for each given Y value. You can 


add arguments or 
(if values are missing) 


TABLE 2: GRAPH OPTIONS 


Function 


<format> Output format 


late it for you. The two arguments you 
can set for -a are the first one for the X- 


Figure 4: The -S marks plots with data point symbols, even if the plot 
ine is hidden (-m0). 


axis increment and the second for its 
lower limit value, as in the example ... -a 
100 10.... 

Also interesting is the -q option, 
whereby Graph fills the polygon formed 
by the plot line segments with varying 


et Graph calcu- 


PROBLEMS WITH DATE 


REPRESENTATION 


If you're working with time-dependent 


data, you have two possibilities. The 


first is to use absolute time with the 


format string +"%s", which indicates 


amount 


-f <size> Font size in pixels 

-F <font> Default font style 

-g <style> Grid style (Othrough 3) 

-h <height> Fractional height of the plot 

-k <length> Length of tick marks 

-K <clip_mode> Activates the clip mode 

-r <shift> Shifts the plot horizontally by a fractional 


the number of seconds since the be- 
ginning of the Unix epoch, January 1, 


Saves the screen 


1970. The downside is that these val- 


-u <shift> 
-w <width> 


Fractional width of the plot 


Shifts the plot vertically by a fractional amount 


ues have become quite high over the 
years. The current date is thereby 
measured in terms of about 1.4 mil- 


itmap-size <X>x<Y> Size of the graph display 


lion seconds when using +"%s", thus 


Amount of points per line 


needing to be converted. In scripts, 
you would use Bc or Dc, in case the 


ors <colors> 
ation <degrees> 


Rotation angle 


Output page type, such as “a4” 
Pen colors as a string, such as “1=red, 2=green” 


-E <axis> Toggles the X and Y axis ends 
-] <axis> Toggles the axis between linear and logarithmic 
-L <label> Text string for the top label 


shell syntax isn’t enough. 

The second option is to use other 
date-formatting strings, such as the 
%d day number or the %/ hour. For 
this approach, you need to ensure that 
these values aren't repeated (i.e., you 


xis> 


Toggles the presence of tick marks on axis 


need to delete the input files for Graph 


often). Alternatively, you can go back 
to using the -a option in Graph that 
creates the automatic X-axis values, 


as long as the distance between val- 


ues remain the same. 


< Sets limits for the X axis 
<li Sets limits for the Y axis 
-X <label> Text string label for the X axis 
-Y <label> Text string label for the Y axis 
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Figure 5: The -q option creates variously shaded surfaces in the plots. 


shading - with 0.5 halfway between 
solid and white, as in the following com- 
mand that generates the plot shown in 
Figure 5. 


$ echo 105 515 1515 105| 2 
graph -TX -q 0.5 


To create a closed surface, the starting 
and ending plot values have to be identi- 
cal. The -q argument sets the density of 
the fill shading, with higher values creat- 


TABLE 3: More GRAPH OPTIONS 


Function 
Defines format; a ASC 


Option 
-I <format> 


-a <increment> 


-B Toggles the line mode 


-m <mode> 


dashed 


-S <number> 


Draws a marker symb 
point; 7 Dot, 2 Plus sig 
Degree, 5Cross, 0No 


error bars, g Gnuplot table format, fSin- 
gle-precision binary, d Double-precision 
binary, i Integer binary 


Automatically generates X axis values 
in the given increment 


Defines the line mode; 7 Solid, 2 Dotted, 
3 Dot-dashed, 4 Short-dashed, 5 Long- 


Figure 6: The fill function applies to curves as well, which are closed 


automatically with a virtual line from start to end point. 


ing darker shad- 

ing. Using the -C adds color to the shad- 
ing. A bit more complicated is filling 
open curves using -q. In this case, Graph 
adds a virtual line from the starting and 
ending points of the curve as the base 
for the filled surface (Figure 6). 


On Axis 

The axes and their labels are important 
plotting elements, and several options 
control them. The -E option can make 


ll; e ASCII with 


Graph draw the axes on the right or top 
instead of the usual left and bottom. 
Using -N < axis >, you can deactivate 
the usual ticks and their labels for the X 
or Y axis. In this case, or later, you can 
relabel each axis with the -X < label > 
and -Y < label > options (Figure 7). 

By default, Graph adds ticks to each 
axis relative to its origin. Using the -x or 
-y option, you can be more specific 
about tick spacing along the axis with 


Y - Axis Label 


ol at each data 
n, 3Asterisk, 4 
symbol 


-W <thickness> 


-q <intensity> 


line segments 


chrome dataset rende: 


Defines the relative line thickness 


Defines the shading intensity (fill frac- 
tion) of the polygon formed from the 


Toggles between color and mono- 


X — Axis Label 


ring 
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Figure 7: You can easily activate and deactivate axis labels. 
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Figure 8: Logarithmic scales and grids help represent data. 


the arguments lower_limit, upper_limit, 
and spacing. If a value is missing or you 
enter a minus sign, Graph automatically 
calculates the values from the data. The 
additional -R < axis > argument tells 
Graph to round the values to the nearest 
integer. 


More Room 

Among Graph’s special features is its 
ability to scale an axis logarithmically. 
You do this with the -l < axis > option, 


fr) ee 
—1x10”®} 
-2x10 
-3 x10} 
-4x10 


—6 «107° 


—6 «102° 


a ee ee ee ree 
0 2%10°4«10°6 x 10°8x 102.010" x10" 


and you can also add a background grid 
to help orientation (Figure 8). 

If the display size isn’t big enough, 
you can use the --bitmap-size option to 
set a new size. The option takes the 
< width >x < height > pixels syntax. 
You can also set the fonts with the -F 
option and their size with -f. Graph ex- 
pects a relative value for the size, such 
as -f .01, based on the minimum dimen- 
sion of the plotting box. 


FURTHER 
POSSIBILITIES 
Apart from the 
Graph program, 
plotutils provides 
other useful pro- 
grams. Among the 
options are Plot, a 
universal converter 
for Graph output; 
Pic2plot, which 
translates Pic draw- 
ings, Plotfont for 
displaying charac- 
ter maps of fonts; 
and Spline for 
“smoothing” data. 
Additional exotic 
programs can be 
used for more spe- 
cialized tasks. 


Figure 9: Data “smoothed” by Spline. 
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Spline reads data 
either from stan- 


dard input or from a file, processes it, 
and then writes it out as a data stream in 
the standard output channel. The data 
can then be fished out for Graph pro- 
cessing: 


$ spline input_data | graph -TX ... 


In Figure 9, you can see the example of a 
curve that was “smoothed” by Spline 
and output to Graph. 


CONCLUSION 

Viewing numerical data as graphs using 
plotutils is a pleasure - provided the 
data is in a reasonable format and can 
be quickly converted. Because of X 
mode, you don’t need to generate an 
output file, and automatically closing the 
output window with a mouse click 
proves ideal for this purpose. 

If you want cleanly created graphs for 
presentations or other purposes, you 
should definitely consider generating 
SVG output and then editing it with Ink- 
scape. The original documentation [2] 
for plotutils reveals many more details. e 


INFO 

[1] Plotutils: http:/www.gnu.org/ 
software/plotutils/ 

[2] Documentation: http:/www.gnu. 
org/software/plotutils/manual/ 
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Gone are the days when we read email solely sitting at our computers. To read 
messages on the move, we now have IMAP which has completely displaced POP 
Trojitá makes IMAP easy, even with accounts with big folders. 


Managing IMAP accounts with Trojita 


NETTING MAIL 


BY MARTIN STEIGERWALD 


he large KDE SC and Gnome 

desktop environments include ex- 

tensive groupware functions with 

KMail and Evolution. However, 
until recently no mail program has ex- 
isted for the Qt environment that just 
manages mails, such as Claws Mail and 
Sylpheed do for GTK. 

In 2006, Jan Kundrat developed Trojitá 
[1] as a Qt/C++ application [2] based on 
an earlier attempt in Python. He de- 
scribes the background in a series of 


blog articles [3], including what he 
didn’t like about other IMAP clients and 
what motivated him to start his current 
project [4]. 

Kundrat explained why simply im- 
proving KMail, which at the time was 
not yet based on Akonadi [5], wasn’t 
the answer. His reason was primarily 
the current IMAP structure, which was 
used in many places, and still is, but has 
some flaws. Even today, KMail still 
doesn’t support deleting emails from 
other IMAP clients with the correspond- 
ing flag [6]. 

Unlike Claws Mail and Sylpheed, 
Trojitá is limited to IMAP and doesn’t 
support POP3 accounts. It also doesn’t 
maintain any plugins except for a single 
one for password storage security. These 
restrictions, however, make it easier to 
develop and make it a fast and efficient 
client. The software was originally inte- 
grated with Ubuntu Touch, but Jan Kun- 
drát removed this integration in October 
of 2014 [7] because the Touch developers 
pursued their own fork, Dekko [8]. 

The central promise of the developer 
is that Trojité opens large mailboxes 
quickly and uses both main memory and 
CPU efficiently. To do this, the program 
uses several advanced IMAP features, 
such as QRESYNC and CONDSTORE for 
fast mailbox synchronization, and 
CONTEXT = SEARCH for live search [9]. 

Unlike programs that began as POP3 
clients, Trojita was especially designed 
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Figure 1: Trojitá runs with Qt5, but you need to do a few things first to make sure it's stable. 


from the outset as an IMAP client. The 
latest release, version 0.4, promises even 
further improvements. 

According to developers, it synchro- 
nizes large mailboxes up to 10 times 
faster than other clients and saves up to 
40 percent memory [10]. Among the 
program’s special features is loading 
only as much data as the users’ view re- 
quires, thus you can open mailboxes 
with 100,000 emails without having to 
wait for the software to create a full 
index [11]. 


INSTALLATION 

The developers offer the program 
through the openSUSE Build Service [12] 
as a package for Fedora, RHEL/CentOS, 
openSUSE, Debian, and Ubuntu, as well 
as the source code [13]. Nightly builds 
[14] provide several enhancements for 
version 0.4.1. Thanks to Qt’s platform 
independence, Trojité also runs on Win- 
dows and Mac OS X. However, the web- 
site currently refers only to the Windows 
installation. 

To take a look at the full functionality, 
the nightly builds are the best option, 
because they enable encrypted pass- 
word storage through Qt keychains 
[15], unlike the released version. 

Keychains use the Gnome Keyring or 
KWallet Manager for KDE, thereby also 


supporting Windows and MacOS X. The 
nightly builds are in English only, with 
the released version interface translated 
into other languages. 

The translated versions come from a 
different repository and the openSUSE 
Build Service currently doesn’t run the 
Python script that loads them. This arti- 
cle, therefore, is based on the English- 
only version. 

To install with the package manager, 
click your distribution’s logo and follow 
the instructions. For Ubuntu 14.04, the 
first line in Listing 1 adds the release 
GPG key to the APT keychain. Line 1 
configures the corresponding repository. 
Using the package manager, you then in- 
stall either the trojita package for the 
current release or trojita-nightly for the 
nightly builds. For secure password stor- 
age, also install the trojita-plugin-qtkey- 
chain package. 

If you later want to switch from the 
nightly build to the release version, un- 
install the trojita-nightly package first. If 
you don’t, you will get a missing conflict 
error message that prevents concurrent 
installations. The same applies if you 
want to install the nightly after installing 
the release build. 

Another option is building the soft- 
ware directly from the sources (see the 
“Compile It Yourself” box), which you 
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Figure 2: Trojitá supports an IMAP account 
along with the usual options for encrypting the 
client-server communication. 


could do if the nightly build is not the 
latest version. 


CONFIGURATION 

Configuring the mail client is easy in 
that you’ll find all the settings under 
IMAP | Settings. On the General tab, use 
Add to add your name and email ad- 
dress. Trojité provides the option of 
using multiple identities. Set Passwords 
to Secure storage via QtKeychain to store 
encrypted passwords. If you want to 
avoid HTML messages, activate Show 
plaintext emails instead of the HTML 
version. 

Configure your accounts under IMAP 
(Figure 2). The program expects the 
usual information like server name, port, 
username, password, and encryption 
method. For Encryption, use the entry 
Use encryption (STARTTLS) or Force En- 
cryption (TLS). The latter uses IMAP 
port 993, and the former uses standard 
port 143 for encryption using STARTTLS 
- a method of initiating communication 
by means of encryption using Transport 
Layer Security (TLS). 

Unlike KMail and Thunderbird, 
Trojité currently supports one account 
at a time only. By using different profile 
startup files in Trojitá 0.4, with the 
--profilename option, you can supply a 
different profile name [8]; however, this 
isn’t the best approach to creating mul- 
tiple accounts. 

Trojitá can start an IMAP server as a 
local process, such as the Dovecot server 
using SSH keys and the SSH agent using 


$ wget -q -0- http://download.opensuse.org/repositories/home: jkt-gentoo:trojita/xUbuntu_14.04/Release.key | apt-key add - 


$ sudo sh -c “echo ‘deb http: //download.opensuse.org/repositories/home:/jkt-gentoo:/trojita/xUbuntu_14.04/ /' >> /etc/apt/sources.list.d/ 
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ssh mail.example.org dovecot --exec-mail 
imap. You also can have a local Dovecot 
on the laptop together with a synchroni- 
zation program, such as Imapsync. 

To send emails, specify under SMTP 
the server name, port, and encryption 
method. If the dialog says Trojitá is using 
port 25 for STARTTLS, you will have to 
modify it, because STARTTLS normally 
uses port 587. For SMTP authentication, 
as is now customary, enter the username 
and password. 

Under Offline, you configure whether 
the software buffers messages and mail- 
box indexes, either permanently or for a 
certain number of days. The buffer is in 
a SQLite database in ~ /.cache/flaska. 
net/trojita/imap.cache. sqlite. In our tests, 
it stored messages for 30 days and up to 
76MB. 

The program creates indexes for both 
the folder and the entire emails in cache. 
This approach helps mainly to unburden 
and separate the IMAP server and net- 
work connection from net emails. Trojita 
provides the three options Offline, Ex- 
pensive Connection, and Free Access in 
the IMAP | Network Access menu. 


Proper REDUCTION 

When using the application, you can see 
how much the developer has trimmed 
down the program. Even though Trojita 
has a rudimentary register for frequently 
used addresses, it isn’t a complete PIM 
suite and doesn’t want to be one. It basi- 
cally follows the structure of many mail 
clients: a menu bar and toolbar at the 
top, the list of folders on the left, and the 
list of emails and the view of one of their 
contents on the right. 

Using the View | Layout menu, you 
can set the alternative Wide layout (Fig- 
ure 3) that makes better use of the space 
on wider screens. However, this makes it 
harder to adjust the width of columns 
for subject, sender, date, and mail size. 
A handle is missing between the Subject 
and From elements for changing the col- 
umn widths, and the others are a bit 
awkward. The setup is, however, good 
for a mailing list with two lines per 
email, similar to KMail [17]. 

The One at a time view shows the list 
of folders, the messages in each, or a 
single message, thereby saving space on 
smaller laptops or mobile devices. Trojita 
somewhat unexpectedly adds new 
emails at the bottom of the list. Using 
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Sorting, you have a few options to help 
you organize them. You can also sort by 
threads if you set a tree structure with 
Show Messages In Threads. 

The Quick Search option proved to be 
quite useful. Among the 88,000 mes- 
sages in the Linux kernel mailing list 
folder, Trojita found the three util-linux 
release announcements in a matter of 
three seconds (Figure 4). Unfortunately, 
we couldn’t find a cross-folder search 
during testing. 

Especially appealing when viewing 
messages is the compact nature of head- 
ings, the ability to assign tags, and the 
appearance of mail quotes [18] with 
vertical-line separations. The program 
displays HTML emails with the standard 


formatting, and you can turn on exter- 
nal images. A zoom function is missing, 
however, which leads to HTML emails 
having too small a print to read easily 
on high-resolution displays. Also, a 
function is missing to copy mail ad- 
dresses through a context menu to the 
address book. 

The send window is also very sparse. 
At the upper left are the fields for the 
sender’s identity and any number of re- 
cipients. Like KMail, Trojité allows cre- 
ating new fields. To the right is a button 
for adding attachments and a list of at- 
tachments, including the actual message 
text. 

You can also use New Thread to open 
a new dialog or change whether the 


COMPILE IT YOURSELF 


To begin, download the Trojita source code using the first line in Listing 2. If you 
want to update it later, use the git pull command. Debian and Ubuntu users should 
get the required dependencies for the build using apt-get build-dep trojita. You get 
the current localized versions from the subversion repository using python 
110n-fetch-po-files.py. 


Trojité requires Cmake, Qt, Zlib, and for secure password storage, it needs Qt Key- 
chain. For Debian and Ubuntu, you install the packages cmake, libqt4-dev, qt4-dev- 
tools for Ot Linguist, libqtwebkit-dev, zlib1g-dev, libqtkeychain-dev and ragel. Then, 
change to the source code directory and configure the source code using the com- 
mands on lines 2 through 5 of Listing 2. 


Once Cmake runs error-free, make -j4 creates the sources, substituting the proces- 
sor core value for the number after -j. With sudo make install, the program then 
ends up in /usr/local. In our tests, it also required calling sudo Idconfig to make the 
system aware of the newly installed libraries. 


For Qt5, you need the Debian packages qtbase5-dev, libqt5webkit5-dev, qt5key- 
chain-dev, qttools5-dev, and qttools5-dev-tools for the Qt5 Linguist tools. Then, use 
cmake -DWITH_QT5=ON, if necessary deleting the CmakeCache beforehand. 


To install in a different directory or make other settings, execute ccmake .. before 
the cmake and adjust the settings. 


Because of a bug in Ot 5.3.1, Ot failed to start with this version. Trojitá did start with 
Qt 5.3.2 but crashed when clicking an email. The Qt Webkit used by Qt5 loaded the 
browser plugin for the X2go remote desktop solution in memory, even though it’s a 
Qt4 plugin. This error was subsequently resolved in the Qt Webkit source code [16]. 
After removing the x2goplugin package, the Ot5 version of Trojitá finally ran (see 
Figure 1). 

Because cmake doesn't create a make target for removal (uninstall) but lists the in- 
stalled files, you can uninstall using cat install_manifest.txt | xargs sudo rm. To 
build a Debian package, use the guide in README. Debian, which explains how to 
build Trojitá yourself based on the files for the openSUSE Build Service. In our 
tests, however, the dpkg-buildpackage -b command required the -rfakeroot option. 


The build dependencies for the package are in the debian/control file under 
Build-Depends. The dpkg-buildpackage command shows what's still missing. The 
-b option is still required; otherwise, the command searches for a source code tar- 
ball that doesn't exist in a Git checkout. Even though the package includes version 
0.3.90 in the filename, dpkg-buildpackage builds a (not exactly current) version 
0.4.1 from July 7, 2014. To avoid going too deep into the Debian packaging, you're 
better off going with the package in the openSUSE Build Service, as this was cur- 
rent at publication time 
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Figure 3: Trojité's wider view is well suited to modern laptops with panoramic displays. Unfortu- 
nately, it's a challenge to adjust the column widths. 


message goes to the sender, all recipi- 
ents, or to a mailing list. The program 
also comes with some basic intelligence 
built in; on mailing lists with matching 
headers, messages go only to the list by 
default. 


PERFORMANCE 

What about the program’s performance 
and efficiency? In our tests, we let the 
software loose on an IMAP account with 
200,000 emails, primarily those from 
mailing lists of open source projects. The 
largest folder was the kernel mailing list 
with nearly 100,000 emails. 

The account was on a Dovecot server, 
one of the fastest IMAP MTAs, that 
saved its email in a Btrfs filesystem on a 
NetApp storage appliance. The test was 
limited to subjective impressions, be- 
cause the server shared the infrastruc- 
ture with other virtual machines, which 
made it hard to reproduce measure- 
ments. For a comparison, we accessed 
the same IMAP account with KMail 
4.14.2 with Akonadi 1.13. 

Trojitá was ready for use right after 
IMAP account configuration, and the ac- 
cess to the large folders was fast. Here, 
the program did well with its competi- 
tors. With KMail, Akonadi was first in- 
volved in loading all folder indexes after 


LISTING 2: BUILD TROJITA 


01 $ git clone git://anongit.kde.org/trojita 


02 $ cd trojita 
03 $ mkdir build 
04 $ cd build 


05 $ cmake .. 


60 ISSUE 25 


barnl-ownee veer kernel org à 
nai@upar kernal org B. Nns-feleve@vge harnelorg 8. 


jer arte à 
Subject: ANNOUNCE] Lux v2.23 
Date: Dienstag 22. jul 2014 113639 CEST 
Ta: 
The utt- release 92.25 is availabe at 
{tpi //tp -bernet 08 patita dimer /2257 
Feedback and tag reports, ay lus, are welconed 


Karol 


HD COTE 


Util-Uma 2.25 Release Motes 


The command cytine {8} has been REROFED from ut: Lit 


The non Libaount sount(8) inplmentation has been REMOVED fros 
urit tiwn. 


raumary output format is deprecated in 


supon --shouteccolumne>]* that provides better c 
etat formatting. 
peu 


Umasrtcots 
= this MEW SIURED LIBRARY (but with stable APT) alow to 
| print data in 


BSS55C5565555555. 


setting up the account, something that 
took an hour or more. 

Trojitá showed no weaknesses when 
accessing the kernel emails folder. It 
loaded only a part of the index and not 
the whole thing. The program first ran in 
Free Access mode with a cache of 30 days. 
This proved to be a problem with quick 
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Figure 4: Fast and practical: a mailing list 
search in one-at-a-time view. 


folder changes or when scrolling through 
the list of messages. Trojité loaded more 
of the index than the user could see to re- 
spond to requests more quickly. 

Unfortunately, Trojita didn’t end old 
queries so that, when changing folders 
or scrolling through the message list, it 
took from 10 seconds to a half a minute 
waiting time while the IMAP server used 
the common memory to capacity. With 
threading enabled, where the application 
loads more contexts to show the partici- 
pation in conversation threads, the effect 
was even more pronounced. 

Once the data was stored, the client 
proceeded more quickly. Curiously, the 
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Figure 5: Trojitá truncates long quotes — useful 
with top postings — and allows applying tags 
to messages. 


Expensive Access option helped in a more 
expensive connection. Here Trojité actu- 
ally loaded only what the user wanted to 
see. The program updated the view in a 
matter of seconds, even when scrolling 
in the kernel mailing list folder. So, if you 
have a connection to a fast IMAP server, 
this option does work better. 

KMail, in comparison, was also quite 
fast after the first scan when accessing 
the folder and its messages - unless 
Akonadi was strongly involved with 
background tasks, in which case it took 
somewhat longer. However, Akonadi 


also constantly ran in the background 
to resolve the IMAP account and store 
the folder indexes in the MySQL data- 
base. For large folders, KMail took some 
time to build the thread view fully, dur- 
ing which time the program was slow to 
respond. 

Although Akonadi took considerable 
time with the indexes in this case of a 
spontaneous access to the IMAP account, 
Trojitá was significantly faster. To offset 
it, KMail provides a really useful and fast 
full-text search of the complete account 
with its Baloo tool, assuming Akonadi is 
running regularly in the background. 

A comparison of a large IMAP ac- 
counts on Exchange showed no signifi- 
cant facts. Both KMail and Trojitá 
showed some wait times throughout, 
which is highly likely because of Micro- 
soft’s IMAP implementation that doesn’t 
support many advanced commands. 


CONCLUSION 

In testing, we liked the Trojita mail pro- 
gram because of its simple structure and 
high speed. Basic functions such as 
threading, message display, and folder 


searching are straightforward and solid. 
Especially appealing in tests was the ele- 
gant display of quoted text. If you want 
to read emails efficiently in a large IMAP 
account, Trojita would make an excellent 
choice. 

Regarding functions such as support- 
ing multiple accounts, full-text search 
across the entire messages, GPG sup- 
port, and more, the program currently 
doesn’t come close to other clients like 
KMail. In the current versions, the 
KMail-Akonadi duo was also convincing 
with larger IMAP accounts in compari- 
son, provided Akonadi was running in 
the background. e 
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All major desktop environments provide programs for taking screenshots; however, their features 


usually pale in comparison with those of Shutter. 


Screenshots with Shutter 


SNAPSHOT 


BY ERIK BARWALDT 


n software manuals, multimedia 
presentations and technical docu- 
mentation screenshots are de ri- 
gueur for illustrating various func- 
tionality and options. Every common 
desktop environment in Linux pro- 
vides its own tool for creating them. 


Unfortunately, programs like 
Ksnapshot are missing various func- 
tions, such as capturing menu hierar- 
chies, thus requiring laborious re- 
working with Gimp to get the desired 
results. Shutter makes this task easier 
by providing all the required tools 
from the start. 


SET THE STAGE 

You can find Shutter in the software 
repositories of all the major distribu- 
tions. Because the program is con- 
stantly evolving, some repositories 
do contain outdated versions for in- 
stallation. 

Although the current source code 
is always available [1], the many de- 
pendencies of the program written in 
Perl make it advisable to resort to a 
prebuilt package [2]. 

After a successful installation, 
you'll find the corresponding starter 
in the desktop menu structure. Shut- 
ter is compatible with Gnome, KDE, 
and Xfce. Once called, the system 
tray will include a new icon that you 
can click without having to maneuver 
through untold menus. 


ESSENTIALS 

Shutter starts up in an unspectacular 
window. At the top edge, you’ll find 
the obligatory menu bar; under that 
is a row of buttons for quick access 
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to the important functions. The main 
part of the window starts out empty 
and will later hold the screenshots. 

The toolbar buttons let you cap- 
ture the full screen, a window or sub- 
window, part of a window, a menu, 
or a freely definable area. You can 
also capture tooltips. Next to the but- 
tons for full screen or window cap- 
ture, you will find three little trian- 
gles that open a drop-down menu 
when clicked. 

From this menu, you can choose 
which desktop interface you want to 
capture, resulting in toggling among 
them. When recording the window of 
an open program, you select it from 
the corresponding menu. This means 
you don’t have to minimize, move, or 
close windows with multiple applica- 
tions open in order to capture the de- 
sired one (Figure 1). 

Another highlight of the software is 
the ability to capture screenshots 
from web pages without needing to 
open the browser and the actual 
page. To use this feature, you need to 
integrate the gnome-web-photo pack- 
age found in most of the major distri- 
bution repositories. 

You activate the module by clicking 
the world icon on the program’s tool- 
bar, which opens a dialog where you 
enter the URL of the web page. Sub- 
sequently clicking Capture at the bot- 
tom right of the dialog makes the 
software try the screenshot. 

If this is not immediately success- 
ful because of a slow Internet con- 
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Figure 1: The main Shutter window focuses on the essentials without 
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Figure 2: A web page screenshot captured by Shutter isn't limited to the 


visual area in the browser, but encompasses the entire page. 


nection, you can set the wait time by 
clicking the down arrow in the mod- 
ule’s submenu. Shutter tries to cap- 
ture the shot in the time specified 
and shows it in the session window 
as usual. 

Unlike browser screenshots, the 
software captures the entire web 
page and not just the part that dis- 
plays in the browser. (Figure 2). 


CONFIGURATION 

Shutter provides unusually extensive 
configuration options in its Edit | Set- 
tings menu. On the General tab, you 
define the default storage format 
along with various options for auto- 
matic backup of screenshots. The 
available storage formats that appear 
in the File Type dialog are PNG, 
JPEG, and BMP. 

On the Advanced tab, you set the 
screenshot size and capture area op- 
tions. If you want to include menus 
and tooltips, it’s suggested that you 
set a capture delay of a few seconds - 
because tooltips usually appear only 
after a one- or two-second delay. 
Even complex hierarchical menus 
need some delay time before you can 
reach the desired item. 

The Actions tab lets you define 
what you want to use as an image ed- 
iting tool after the capture. The de- 
fault is the integrated Shutter editor, 
which provides an efficient tool on a 
smaller scale. Other important set- 
tings can be found on the Behavior 
tab, such as the startup nature, 
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alerts, window settings, and removal 
routines. 

The Upload tab allows an uncom- 
plicated saving of the screenshots 
through various cloud services, such 
as TwitPic, Imgur, or ImageBanana. 
You can upload the images anony- 
mously there or under your own ac- 
count - that is, authorized. If you 
choose the latter option, you will 
need to add your username and pass- 
word for the service in the configura- 
tion dialog. 

To upload screenshots to your in- 
frastructure, enter the setting under 
Protocol for Data Transfer (FTP). In 
this case, the screenshot can be 
saved in the cloud without going over 
a web page or a third-party program. 
Just click the Export button in the 
toolbar and choose the desired ser- 
vice from the list (Figure 3). 

Shutter also has a command-line 
option that provides an extensive set 
of parameters that accompany those 
of the graphical interface. To see all 
the options, you can enter the shutter 
--help command. 


PROFILES 

Certain types of screenshots always 
require the same settings. To avoid 
having to configure options over and 
over again in the dialog, you can save 
them in a profile. You can do this by 
clicking the stylized hard disk icon 
button in the upper right and enter- 
ing a distinguishing name for the 
profile. 
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Figure 3: Shutter lets you publish screenshots at various image provid- 


ers or save them on your own FTP server. 


Shutter saves the new profile on 
the Save button. To use the pre- 


defined profile for a later screenshot, 


open the Edit menu and choose Pro- 
file Selection. 


EXTENSIONS 


The Plugins tab includes the various 


extensions that you can get for the 


software. The available plugins allow 


customizing screenshots with effect 
filters. You get to the corresponding 
dialog by selecting Screenshot | Exe- 
cute Plugin. There, you can choose 
the plugin you want to use. 

Other plugins are also available, 
such as Drop Shadows or Water- 
marks, along with a few less useful 


ones, such as Barrel Distortion or In- 


version. 

The fact that some of the plugins 
were less than optimal was shown 
during testing with Watermarks: 


When modifying the display position, 


Shutter crashed unceremoniously 
after accepting the changes. 


FINAL TOUCHES 
After creating a screenshot with the 


desired settings, the software shows it 


in the free area of the window. Shut- 
ter attaches the screenshots to sepa- 


rate tabs and stores them at the same 


time in the configured images folder. 
Shutter also activates two addi- 


tional buttons on the right edge of the 


menu bar. Clicking the left button 
opens the editor window where the 
screenshot appears enlarged. 
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Figure 4: An image editor specially tailored for screenshots extends the 


already numerous Shutter functions. 


Above it, you’ll see various func- 
tion buttons with which you can 
save the screenshot, enlarge it, re- 
duce it, undo the last action, or save 
the image on the clipboard. You can 
also move other screenshots from the 
clipboard to the window. 

On the left side of the editor win- 
dow, you'll find vertically organized 
icons similar to those in the Gimp 
toolbox, with the functions to 
match. With these tools, you can 
highlight parts of screenshots using 
lines, arrows, rectangles, or circles 
(Figure 4). 

The toolbar also includes func- 
tions that let you select text pas- 
sages or pixelate certain areas. A 
censorship function covers any af- 
fected areas with a gray screen and 
makes them virtually unrecogniz- 
able. Finally, a cropping function 
lets you extract vital areas from the 
screenshots. 

If the editing functions don’t suit 
your purposes, you can use Screen- 
shot | Open with... to open an exter- 
nal editing program. The resulting 
dialog shows all the graphics pro- 
grams that are resident on the sys- 
tem. This feature avoids any annoy- 
ing detour to a save dialog and the 
subsequent manual launch of an 
image editing program. 

Our tests with version 0.90.1 under 
openSUSE 13.2, however, showed 
that the software was not fully ma- 
ture. Although the Settings | Open 
with... window listed all the installed 


graphics programs, the above-men- 
tioned dialog remained empty. 


EXPORTER 

You save the screenshots using File | 
Save as.... Shutter stores them by de- 
fault in the PNG file format. However, 
if you click File Type in the dialog, a 
drop-down menu shows all the addi- 
tional file types that Shutter supports, 
including TIFF, JPEG, JPEG2000, and 
GIF. 

Alternatively, the software lets you 
export the screenshots as PDF or Post- 
Script documents. To do so, in File 
choose the corresponding option and 
enter the file name and path in a sub- 
sequent save dialog. Because Shutter 
saves the current screenshot in the 
clipboard, you can easily open it in an 
external application. 


CONCLUSION 

Shutter stands out because, unlike the 
standard programs of the various 
desktop environments, it considers 
even exotic needs and places great 
emphasis on practicality. Bloggers and 
authors can benefit from its excellent 
editing functions - particularly the 
possibility of editing screenshots. « 


INFO 


[1] Shutter source code: http:/ 
shutter-project.org/downloads/ 
source-code/ 

[2] Shutter packages: http:/pkgs.org/ 
search/shutter 
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Linux provides several tools for maintaining mass storage. Gnome Disks combines the most 
important functions into one interface. 


Toolbox for mass storage 


INTENSIVE CARE 


BY ERIK BARWALDT 


ard drives, because of their com- 
plex mechanics, are sensitive to vi- 
bration, heat, voltage fluctuations, 
and power outages. Since the 
1990s, hardware providers, notably IBM 
and Compaq, have pondered how to im- 
prove performance security. The resulting 
different technologies ultimately resulted in 
the 1996 Self-Monitoring Analysis and Re- 
porting Technology (SMART) standard that 
monitors many hard drive hardware pa- 
rameters and triggers alarms when thresh- 
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olds are crossed. Although the parameters 
haven’t been fully normalized, they've 
been embedded in the firmware of almost 
all hard drives in various forms. 


JUMBLE 

Even though all SATA hard drives in famil- 
iar form factors support SMART, their cor- 
responding values aren’t always readable. 
External drives running over the USB bus 
in particular reveal the data only when the 
USB-to-SATA bridge electronics provide a 
data tunnel, which isn’t the case with 
many of the cheaper external drives. 

The same is true for external mass stor- 
age with universal plugs. Even some of the 
more high-quality external hard drives that 
operate with combined USB and Firewire 
ports to the computer can’t have their 
SMART values read for lack of bridge func- 
tions - even if the hard disk on the external 
device is SATA compliant. 

Even high-quality server hard drives that 
comply with the SAS specification don’t al- 
ways cooperate with the SMART. They 
need to support the SAT standard to trans- 
late the SCSI commands in the SATA com- 
mand set. If in doubt when purchasing a 
new hard drive, you should carefully read 
the specifications. The manufacturer usu- 
ally indicates in the data sheets if a mass 
storage device is SMART-compliant. 


SOFTWARE 

To prevent data loss from corrupt mass 
storage, Linux provides countless tools and 
programs, including the Smartmontools, 
which are found in practically all distribu- 
tion repositories. After installation, these 
tools provide extremely powerful testing 
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Figure 1: The Gnome Disks interface is a clear one. 


capabilities on the command line that offer 
a huge number of parameters due to the 
range of functionalities. 

Such functionality comes at a price, how- 
ever. For example, it can be hard to figure 
out what you’re looking for and seeing. A 
much simpler solution is to work with a 
graphical front end to Smartmontools, such 
as GSmartControl, which is also found in all 
major distribution repositories. A special 
place for such graphic interfaces for moni- 
toring hard drives is reserved for Gnome 
Disks [1], which you can also install on 
other desktops beside Gnome. It combines 
monitoring software with different utilities 
for disk partitioning and benchmarking, so 
it can replace several conventional graphical 
front ends for monitoring and maintaining 
mass storage devices. 


FIRST START 

After successfully installing the gnome-disk- 
utility package available in all major Linux 
distribution repositories (including Ubuntu) 
in 32-bit or 64-bit versions, type disks into 
the HUD. Clicking on the Disks utility then 
opens the program without requiring root 
privileges (Figure 1). 

The program window is clear and highly 
intuitive. On the left, arranged vertically, are 
all the drives the utility has discovered. On 
the right are the details for a selected drive 
in a large area of the window. 

Gnome Disks displays the partitions table 
as a horizontal bar and shows the current 
“health” of the storage devices as the As- 
sessment on the right, along with its current 
temperature. Optical drives show data only 
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serted media. There 
is no traditional 
menu bar, and only 
one menu item: 
Disks, which con- 
tains three options. 


| for the currently in- 


INTRINSIC VALUE 
To view the detailed SMART values for a 
storage device, click the gear symbol in the 
upper right corner. This opens a selection 
menu with, among others, the option 
SMART Data and Tests.... A new window 
appears with details about the current state 
of the drive. The software doesn’t list all the 
available attributes and values as some other 
tools do — just the current ones that the drive 
itself reports. The Assessment column re- 
ports the current health (Figure 2). 

If you're confronted with unclear values, 
click the Start Self-test button at the bottom 
left of the program window to start one of 
three test routines. A test can take a few 
hours, depending on 
the disk size. To 
launch the test, se- 
lect it from the menu 
and enter the root 
password. Gnome 
Disks then displays 
the test progress and 
eventually its results 
(Figure 3). 
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Figure 2: The Gnome Disks assessment window provides further details. 


You previously needed to correct these ag- 
gressive values for battery mode in Linux 
with a manual configuration of the parame- 
ters with help from the hdparm command. 

In Gnome Disks, however, you can simply 
use the Drive Settings... menu item. Activate 
the Advanced Power Management through a 
button and adjust the slider somewhere be- 
tween the end values Save Energy and Im- 
prove Performance. You can also use a slider 
to adjust the standby time for hard drives. 


PERFORMANCE 

The performance tests that Gnome Disks 
provides go far beyond the capabilities of a 
mere status query. You can use them to de- 
rive the write and read rates of each parti- 
tion, where you can define the number of 
samples for evaluating these rates. 

To start the tests, select the partition and 
click the little gear symbol under it. Choose 
Benchmark... and Gnome Disks will take 
you through a few steps to determine how 
extensive a test you want and whether you 
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Figure 3: The test routines show the progress with a bar. 
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Figure 4: Gnome Disks determines fairly quickly if your mass storage is a 


hare or tortoise in terms of speed. 


want a pure read or write test. Before you 
embark on a write test, however, be sure to 
back up the partition to avoid any data loss 
risk. Gnome Disks then asks for your root 
password and executes the routine. The 
speed tests results appear graphically and 
meaningfully in a new window (Figure 4). 
If you want to get speed results for the en- 
tire disk instead, click in the upper right on 
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Figure 5: Gnome Disks isn't modifying the 
imited to one filesystem. partitions. You 
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don’t need any ad- 
ditional software to 
do so; Gnome Disks 
handles this quite well. Highlight the af- 
fected drive and the respective partition in 
the left pane. Clicking the gear button below 
it opens the Create Disk Image... and Restore 
Disk Image... menu items. 

Before editing a partition, be sure to make 
an image copy first to eliminate any chance 
of data loss while modifying the data struc- 
ture. The IMG file that contains the image is 
best saved in a folder on an external backup 
drive - to enable reconstruction in case of 
data loss. 

Make configuration changes using primar- 
ily the Edit Partition Type... and Edit Mount 
Options... menu items. Pay particular atten- 
tion when selecting a non-Linux filesystem 
when modifying the filesystem type for a 
heterogeneous environment. Other operat- 
ing systems will recognize very few filesys- 
tems. If in doubt, FAT16 or FAT32 should 
prove the safest options. 

The actual disk reformatting is done 
through the Format... menu item. In the re- 
sulting dialog, enter the desired filesystem 
and choose whether you want to have it en- 
crypted with LUKS. You also have the option 
of overwriting the existing sectors with 
zeros. This step can slow down reformatting 
considerably, although it completely re- 
moves old data safely. 

Please note, however, that this process is 
not suitable for modern SSD disks. In this 
case, the internal controller manages the 
data storage, and data cannot be recon- 
structed in the same way as with hard 
drives. You can use Gnome Disks, however, 
to reliably clean up existing mobile device 


Figure 6: Mounting and unmounting is easily done in a graphical dialog. 


storage if, for example, you want to sell it 
(Figure 5). 


HANG-UPs 

Gnome Disks lets you mount and unmount 
partitions on the fly and set the desired 
mount options. To unmount an already 
mounted filesystem, click the little square 
underneath the graphical drive bar. This dis- 
ables the filesystem, which often involves 
some intensive work. 

If, instead, you want a previously inactive 
partition to be mounted automatically at 
startup or to set up password authentication 
for it when mounting, you can make the nec- 
essary modifications graphically through the 
Edit Mount Options... menu item. You can 
also get to the function using the gear button 
directly below the graphical disk indicator. 
The tool opens a clear dialog where you make 
the desired settings but warns explicitly 
against any ill-advised modifications that 
could render a system unusable (Figure 6). 


CONCLUSION 

Gnome Disks proves to be an easy-to-use and 
useful tool for more than just the Gnome 
desktop, and it combines many features of 
the hdparm, smartctl, dd, and mount terminal 
commands. It may not provide their full range 
of functions, but it gives you the important 
and most frequently used ones. As a result, 
even beginners can get along well with 
Gnome Disks. The software should be a 
standard part of every user’s desktop. e 


INFO 


[1] Project page: https:/launchpad. 
net/gnome-disk-utility 
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RODENT FILE MANAGER 


The Rodent data manager can do more than just move files. However, it's not always easy or 


intuitive to use. 


Rodent data manager tries to score with additional features 


Mouse TRAP 


BY MARIO BLAETTERMANN 


ost desktops include a 
central data management 
tool. Of these, most fall 
into the category of “ex- 
plorer with sidebars and a copious 
main window.” Terminal relatives 
such as the Midnight Commander use 
the two-column concept instead. Ro- 
dent [1] lies in between - although it 


is equipped with a graphical interface, 
it pursues either approach with equal 
gusto. It doesn’t rely on a true two- 
column layout, but it comes close 
with the use of tabs and provides the 
possibility of entering on a command 
line or in edit fields under almost any 
circumstance. 

In some ways, this approach stems 
from the legacy of the old Xffm [2] file 
manager and also parallels the behav- 
ior of gVim [3]. Generally, however, 
the developers want to break new 
ground by providing far more than 
just managing files. Unfortunately, in 
testing, working with Rodent wasn’t 
always easy (see the “Installation” 
section for details). 


INSTALLATION 
Binaries for Rodent are rare. Packages 
exist only for Fedora, OpenMandriva, 
and Alt Linux. Along with them, 
you’ll find its almost unavoidable 
presence in the Arch Linux user re- 
pository and an outdated Ubuntu PPA 
[4]. Gentoo Linux has an ebuild and a 
port for FreeBSD. The latter is based 
on an older GTK2 version, because 
GTK3 has not proven compatible with 
BSD derivatives even after years. 
Those who wish to compile from 
source will need to take a deep 
breath. The release tarball is available 
online [5]. The Rodent project pro- 
vides two of its own libraries - Librfm 
and Libtubo - that are necessary for 


compiling and that require prior 
building and installation. 

Also required are GTK3 and Libdbh, 
along with further libraries depending 
on features and the procps command- 
line program. A current list of the nu- 
merous build dependencies are in the 
control file of the Fedora RPM pack- 
age [6]. Once you've gathered every- 
thing together, installation is done 
with the three-step configure && make 
&& make install. 

Or, at least, that’s the theory. The 
truth is, for Ubuntu, the process is a 
little harder. We tried installing ro- 
dent using the latest stable source 
files and, when that failed, we tried 
installing the suite using the nightly 
unstable code downloaded form the 
project’s Git repositories. And that 
failed, too. 

You can choose to install the rather 
outdated PPA that is available [4]. 
This also needs some tweaking to 
work, because there is only a version 
of Rodent up to Precise Pangolin, and 
you're probably running something 
more recent. 

To get this running, first, you have 
to add the PPA to your repo lists: 


sudo add-apt-repository 2 
ppa: landronimirc/rodent 


This step also pulls and confirms the se- 
curity key. 

Then, you have to open the created 
repo file: 


sudo vim /etc/apt/sources.list.d/2 


Jandronimirc-ubuntu-rodent-utopic.list 
and change the line 


deb http://ppa.launchpad.net/2 
Tandronimirc/rodent/ubuntu utopic main 


to 


deb http://ppa. launchpad. net/2 
landronimirc/rodent/ubuntu precise main 


After that, it is just a matter of doing a 
sudo apt-get update and a sudo apt-get 
install rodent to install the software. 

The problem with this solution is 
that this version of Rodent is really old 
and does not come with many of the 
goodies described in this article. Do 


not despair, you can install something 
more recent quite painlessly. 

First, download the deb file for ver- 
sion 5.0.5 by doing the following: 


wget http://sourceforge.net/projects/ 2 
xffm/files/5.0.5/deb/2 


debian-7.1/rodent_5.0.5-1_amd64.deb 


Install with dpkg: 


sudo dpkg -i rodent 5.2.5-1 2 


ubuntuuser (/home/ubuntuuser) 


Dhome/ubuntuuser 


amd64.deb 


And check for 
dependencies 
with APT: 


sudo apt-get 2 
install -f 


Rodent pro- 
vides a desktop 
file for all the 
“applications” 
that you will 
find in the 
menu. If the 
desktop file is 
missing because 
you want Ro- 
dent to run 
things without 
the menu, you 


D ubuntuuser (containing 24 items) 


bly rodent-root if you want to entrust 
things at that level. 


TOOLS FOR EVERYONE? 

Even on the project webpage, you’ll 
see the phrase “not for dummies.” In 
fact, Rodent is not a program that you 
simply open and run. The window 
displays a familiar image after a 
startup (Figure 1): a view with icons 
of the home directory. However, you'll 
search in vain for a menu bar or set- 
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Figure 1: An unspectacular window provides a familiar view at first 
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Figure 2: You invoke all actions through the comprehensive context menu. 
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right can help. If you slide it to the 
right, the icons and thumbnails in- 
crease in size. Sliding to the left de- 
creases their size, ultimately leading 
to a list-only view. 

Rodent remembers the given view 
and magnification factor for each 
folder. Caution is therefore advised: 
Views have different mouse and key- 
board settings even as a default. Dou- 
ble-clicking an icon opens the file, 
whereas double-clicking a list item 
opens an entry field for renaming the 
file. 

In the event that the window man- 
ager doesn’t have its own application 
menu and doesn’t activate a panel or 
similar operation that opens a menu, 
you have the option of borrowing it 
from Rodent (Figure 3). 


» Œ Screenshot (gnome-screenshot) 
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ting options. If you right-click any- 
where between the icons, Rodent 
opens a comprehensive context menu 
(Figure 2). 

The usual actions, such as creating 
new files and folders, you'll find in 
the File submenu. The Go To menu 
provides shortcuts to popular places, 
such as to the personal folder, remov- 
able media, root directory, and Samba 
network. 

In the upper right of the tools list, 
you'll find at least some of the items 
you typically find in other programs. 
You can open a new program window 
or a new tab, change the sort order, 
show file properties, and do a few 
other things. 

If you prefer a view with icons, ac- 
tivating the little slider at the bottom 


Even though 
Rodent scans for 


guration Indings 


mere absence. Even in the alternative 
icon menu that you can get to using 
Go | Application Starter, there was 
nothing of the sort. You will see fold- 
ers named GTK and Gnome, so that 
the menu makes partial sense as pre- 
dominantly populated by Gtk software 
computers. 


PERSONAL PREFERENCES 

In the context menu, the last entry 
provides access to settings. Apart 
from the general parameters for font, 
icons, and key shortcuts, the Desktop 
tab lets you disable Show Desktop 
Grid if you want to avoid icons that 
are becoming unfashionable. At this 
point, you can also disable showing 
the background image. 

On the Environment Variables tab is 
a sort of new version of the Gconf edi- 
tor that looks a bit like the Windows 
Registry editor. Here you get every- 
thing you can set, some of which has 
not (yet) made it to the menus. De- 
scriptions of the variables are missing, 
but their meanings can be inferred 
from the names or values. 

Some of the elements that at first 
may seem cryptic are nothing but 
commands that the application uses 
for various file operations. Their use- 
fulness depends on how comfortable 
you are with tools from the GNU 
world. The file operations directly 
rely on them and can’t be easily 
adapted to other tools. Rodent doesn’t 
provide tool tips or other help, so a 
glance at the man pages might ex- 
plain things. 

Fans of the keyboard are a main tar- 
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Figure 4: The file manager provides the option of setting detailed key- Figure 5: If needed, you can define what program you use to open a file. 
board shortcuts. However, there's no simple way to store this mapping. 
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For opening files, the program uses the mappings of 
the MIME types indicated by the system. The desktop 
files that each program installs set the assignments. 
The software can also open files with programs not 
listed there (Figure 5). However, there is no easy way 
to save these assignments - the only option is to create 
your own desktop file in the «/.local/share/applica- 
tions file. 

The 10 displayed buttons in the toolbar have no de- 
fined limitation. In General | Set up Toolbar, you can 
expand the toolbar, with dozens more available en- 
tries. Even without a real menu bar, this makes access 
to the functions much easier. 


INCOMPATIBLE 
Additionally, a certain incompatibility with integrated 
work environments is noticeable. Rodent feels much 
better in combination with a simple window manager, 
especially when the concept goes beyond that of a file 
manager and assumes some of the functions of a full 
desktop. Many errors emerged in KDE in combination Fd thehioles before 
with the standard Oxygen theme, but Rodent had no coe 
problem with the more simple LXQt. VE EDI - pba: | elas 

Some of the language translations were a bit incon- - F 
clusive, and some of the context menus were inaccu- í L | N U b4 


rate as well - requiring some study to make sense of É i e = MAGAZINE 
tnem: LINUX F (any 
CONCLUSION de. 
Rodent polarizes users into camps much like its ancestor We conn eos CE 

5 ane from 5 leading vendors 
Xffm - until Thunar took over as a more intuitive central w 


tool. Although Rodent almost disappeared from the ? ve E 3 

scene, development is still proceeding actively. Unfortu- : 

nately, only very few distributions, if any, have current l j N U X ET LatestRelease! NY 
a [ MAGAZINE 7 openSUSE |3,2 


packages on board. 

Nevertheless, if a terminal is part of your daily re- 3 «conveniences me 
quirements, if you're not bothered with the somewhat : 
unconventional and sometimes oblique and idiosyn- $ 
cratic behavior of its file manager, and if you aren’t Toa fo comming 
daunted by its sharp learning curve, you should take a 
look at Rodent. You can decide for yourself, is it a bug or 
is it feature? Perhaps Rodent will develop into just the 
right tool and satisfy your cravings. « 


INFO 


[1] Rodent: http:/xffm.org 
[2] Xffm: http:/xffm.sourceforge.net/xffm-filemanager. 


html 
[3] GVim: http:/www.vim.org r @ r yo u r 


[4] PPA for Rodent: https:/launchpad.net/~landronimirc/ 
+archive/ubuntu/rodent 


T e 
[5] Source code: https://sourceforge.net/projects/xffm/ ri a | n OW | 
files/ © 


[6] RPM spec: http:/pkgs.fedoraproject.org/cgit/rodent. UK £ 3, Europe € 3, USA / Canada USS 3, 
git/plain/rodent.spec Rest of World (by Airmail) US$ 9 
Terms and conditions: http://goo.gl/SSSQer 


shop.linuxnewmedia.com/trial 
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Using MyPaint and a graphics tablet, you can create or trace drawings with the feel of real pens 
and brushes. All the necessary tools are included. 


Realistic drawing with MyPaint 


PEN & PAPER 


BY KARSTEN GUNTHER 
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yPaint tries as much as possi- 
ble to emulate the use of brush 
and pen in a classic drawing 
program. Of course, there are 
limits, but the program provides numerous 
features that are hard to achieve with ana- 
log materials, To fully exploit MyPaint's 
potential [1], don’t operate it with a 
mouse; instead use a pressure-sensitive 
input device - typically a graphics tablet. 
Modern Linux kernels provide pretty 
good drive support for Wacom tablets and 
similar models from other manufacturers, 
although the latter pale in comparison. 
The hardware should also be recent 
enough (maximum five years 
old) to support the 
graphics 


A first indi- 
cation of whether Linux sup- 
ports the device 

comes with the call 


distribution. If the input device is recog- 
nized (it may even appear multiple 
times), “only” the normal configuration is 
available. I’ll talk more about this in the 
next two sections. 

The description of the device (e.g., 
Wacom Bamboo Pen Pen...) may differ de- 
pending on your particular equipment. If 
you can’t find the input device through the 
command, several possible error sources 
and associated remedies can come into 
play. The best solution is to seek out a 
forum for your distribution [2] and look 
for postings that might help you. 


TABLET SETUP 
Setting up the graphics tablet takes several 
steps. The kernel needs to load and initial- 


tablet ize the module, you define the basic prop- 
success- erties in the desktop environment, and the 
fully. applications need to set up special proper- 


ties of their own. Getting the kernel to rec- 
ognize the input device presupposes set- 
ting up and enabling its support. This re- 
quirement becomes evident when booting 
and connecting the tablet (Listing 2). 

Once the kernel detects the input device, 
you can configure it using the tools of the 


to xsetwacom (List. LISTING 1: LIST oF Devices 


ing 1). The program 
comes from the 


$ xsetwacom --list devices 


: Wacom Bamboo Pen Pad pad id: 16 type: PAD 
xf86-input-wacom 
Wacom Bamboo Pen Finger touch id: 17 type: TOUCH 
package or some 
aie Wacom Bamboo Pen Pen stylus id; 18 type: STYLUS 
similarly named 
Wacom Bamboo Pen Pen eraser id: 19 type: ERASER 


package in another 
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desktop environment. In Gnome and 
Unity, the process is particularly easy. The 
Control Center has a special tool for config- 
uring (Wacom) graphics tablets (Figure 1). 
The setup is similar with KDE. 

Using the Mouse Tracking function, you 
can define how the tablet maps to the 
screen. You would normally use the Tablet 
(absolute) setting that causes the active 
area of the tablet to cover the entire screen. 
In this mode, the screen pointer position 
corresponds to the pen position on the tab- 
let. Alternatively, you can use the Tablet 
(relative) mode, where the pointer isn’t ini- 
tially repositioned but moves relative to the 
pen. This mode works best with small de- 
vices and takes a bit more time to operate. 

In Assign Screen, you can determine if 
the pen is supposed to work on selected 
screens or on all screens. This setting takes 
into account that graphic users like to have 
multiple screens open: for drawing, for 
tools, for settings, and other tasks. 

The next step is to adjust the characteris- 
tics of the input device. Many Wacom pens 
come with a built-in virtual eraser. To 
avoid activating it accidentally, you can set 
a pressure threshold for it in advance. 

The next two settings for the pen but- 
tons are a bit ambiguous. Essentially, 
you're setting what happens when you 
press one of the buttons. In most cases, 
the default setting of emulating mouse 
button behavior is a good choice. How- 
ever, you can attach other functions to 
these buttons. Doing so proves a bit con- 
fusing, in that programs such as MyPaint 
provide similar functionality that then 
takes over. This functionality might require 
some slow and methodical adaptive work. 

Particularly important is the last slider 
that you use to set the pressure threshold 
of the pen, which determines characteris- 
tics such as how thickly lines are drawn 
(Figure 2). MyPaint again has an analo- 
gous function. 


IN THE TERMINAL 
An exception is the Xfce desktop that cur- 
rently has no tool for configuring graph- 


Wacom Intuos PT S Pen 


TrackingMode | Tablet (absolute) x | 


Left-Handed Orientation [___) OFF) 


Map to Monitor. 


General Pen 


| Eraser Pressure Feel Soft —— Firm 


Top Button | Right Mouse Button Click ~ 


Lower Button | Middle Mouse Button Click v 


Tip Pressure Feel Soft 


Firm 


Figure 1: Use the tools of your desktop environment — in this case Unity — to configure the basic 
graphics tablet settings. 


# ROS 


Me? 


Mode: Normal 


Wacom Intuos PT S Pen 


Tracking Mode | Tablet (absolute) x 


LeftHanded orientation [ TORA 


Map to Monitor. 


| General Pen 


Eraser Pressure Feel Soft nn Firm 
Top Button | Right Mouse Button Click © 


Lower Button Middle Mouse Button click + 


Tip Pressure Feel SA = Fem 


Figure 2: A characteristic of graphics tablets is that the pen pressure determines the thickness of 
a drawn line. 


ics tablets. It’s therefore desirable to 
maintain the settings of the Gnome Con- 
trol Center. This isn’t currently the case 
(with Xfce 4.10), but there is a work- 
around [3]. 


$ xsetwacom --set "Wacom Bamboo Pen 2 
Pen stylus" mode absolute 


Substitute your particular device for the 
description in quotes. You can also use 


Another approach is to use xsetwacom, 
where you can enter all the supported 
properties from the command line. To ac- 
tivate absolute mode, for example, you 
would enter the following: 


LISTING 2: CONNECTING THE GRAPHICS TABLET 


the keyword modetoggle to toggle be- 
tween absolute and relative mode. You 
can define the curve for setting the pres- 
sure sensitivity using two anchor points; 
the keyword is PressureCurve followed 


[£ 104.396599] input: Wacom Bamboo Pen Pen as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.1/2-1.1,3/2:1.1.3:1.0/0003:056A:00D4.0003/input/input16 


E 104.398681] wacom 0003:056A;00D4.0003: hidraw2: USB HID v1.00 Mouse [Wacom Co.,Ltd. CTL-460] on usb-0000:00:1d.0-1.1.3/input0 


[ 104.398843] input: Wacom Bamboo Pen Finger as /devices/pci0000:00/0000:00:14.0/usb2/2-1/2-1.1/2-1.1.3/2-1.1.3:1.1/0003:056A:00D4:0004/input/inputi 


{ 104.399072] input: Wacom Bamboo Pen Pad as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.1/2-1.1.3/2-1.1.3:1.1/0003:056A:00D4.0004/input/input19 


£ 104.399391] wacom 0003:056A:00D4.0004: hidraw3: USB HID v1.00 Device [Wacom Co.,Ltd. CTL-460] on usb-0000:00:1d.0-1.1.3/inputl 
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— DESKTOP —__MyPawr 


(Penn | Buttons saving View : 
| input Device 


Peninput | Buttons | Saving | View 


ation sutton press | 


TABLE 2: KEYBOARD SHORTCUTS 


Function 


Keyls) 


| Scale input pressure to bruh pressure. Tiss Gr <PrimaryeButtont n 

Re ee A Zoom view <PrimanpButonz Ctrl+N New image 
| T Edit Frame <Primarye<sittobutond 

BAG Lines and Curves <Shift>Button1 Ctrl+N Open image 
A 5 RotateView <Sht-Bution 
| ae i Solver {rated Ctrl+E Export image 
LA < Edi <Shift><Alt>Button2 
LS 5 cies pent = Ctrl+Page-up New layer over cur- 
z Piek Cola <AbBattont 

i a as á rent 

g Sa 2 Ctrl+Page-down | New layer under 
eo ue +- current 
| ite te same tons that ca 34 down = 

space cmb edhe tar Nota se pdt hae buttona that ao eel ow Sane nee oué 
Revert || OK Revert | OK || board 

Figure 3: MyPaint lets you configure the pressure sensitivity of the pen and the actions of the pen Ctrl+V Paste from clip- 


buttons. 


PERS 


LE x P7202 BASH 


2 > Babes Kx 
Classic Experimental Favorites 
Sets? setas 


EREA 


a- ayes K x 


Figure 4: The MyPaint interface assembles the tools at the top edge. The dock at the right edge J 


shows information and lets you select colors, brushes, and layers. 


by four space-separated parameters. The 
man pages (man xsetwacom and man 4 
wacom) describe the different configura- 
tion options. You can find further details 
in the Linux Wacom wiki and the Linux 
Wacom project homepage [5]. 
The third setup phase is carried out di- 

rectly in the application using Edit | Set- 


TABLE 1: PEN TIPS 


Differently animated tips that change shape in rapid succession dur- 


tings in MyPaint (Figure 3). The first tab 
lets you set the pressure sensitivity 
curve. This function is directly related to 
the desktop environment setting, so re- 
ciprocal actions may occur. 

The same goes for the key bindings on 
the second tab. If you set the default 
mouse emulation mode in the desktop 


These tips simulate realistic drawing instruments, such as brushes, 
soft and hard pencils, markers, airbrushes, calligraphy nibs, or spat- 


User-selected tips that are dragged and dropped from other groups. 


Tips for precise etching, painting, blurring, and many other func- 


Group Characteristics 
Classic 

ulas. 
Experimental 

ing application. 
Favorites 
Lost&Found |T 

tions. 
Set#1 Similar pens. 
Set#2 Various brushes. 


Set#3 Special, mostly animated tools. 
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board 
Turn stepwise left 


Ctrl+Left-arrow 


Ctrl+Right-arrow | Turn stepwise right 


Ctri+S Save image as 
OpenRaster 
Shift+Ctrl+S Save image as 


Ctrl+Z Undo 

zZ Undo 

“y Redo 

[Delete |Emptylayer | 

„and + Reduce view 

,and- Diminish view 

F2 Save image as scrap 

F3 Open last image 

F5 Undo 

F6 Open previous scrap 
as image 

F7 Open next scrap as 
image 


Full screen mode 
Reduce opacity 
Increase opacity 
Select brush 
Reduce brush 


Increase brush 
Select colors 


Mirror vertically 


Draw circles 


Draw freehand 
Color pipette 


Symmetrical draw- 
ing 
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E” 5 = 


Change Brush Quick Brush Settings 
Radius: 
Slow position tracking 
Opacity: 


Hardness: — 


Detalled Brush Settings 


Settings | Window Ji 


Brush Blend Mode 


_ Brushes Window. 


Normal 
Recently Used 


ERSEN 


Eraser 


Lock Alpha Channel 


Be | 
Une Mode | 
or etre LER ME | 

Line Pressure | 
e+ | 

A i i | 

7 Xi | 

“ | 


Colorize | 


Figure 5: The important MyPaint functions are easily reachable. You select the brush tips, set their 
behavior, and determine how the program interprets brushstrokes. 
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& x Colors 
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aa le 


he dock by pulling it from the right edge. 


environment, it’s possible to use it here. 
However, MyPaint supports only key 
bindings with combined with modifiers 
such as Ctrl, Alt, and Shift for some 
keys. 


OLD AND NEW 

The MyPaint interface for the current 
version 1.1 is clearly structured and 
clean (Figure 4) with little distraction 
from the canvas. Because the tools are 
at the top edge, you can change 
brushes, characteristics, and line styles 
quickly (Figure 5). It takes only a few 
parameters to make the necessary ad- 
justments. Also, MyPaint 1.1 allows 
using Gimp color palettes [6], which all 
major distribution repositories should 
now include. 

The layer concept has a special signifi- 
cance in MyPaint. The program supports 
an unlimited number of layers to man- 
age the parts of an image separately. 
These layers are managed in a dock, 
where you can activate single layers with 
a mouse click. Clicking the eye icon 


Figure 6: The dock contains only certain tools, which become available throughout. You position 


hides the layer but does not delete it. 
MyPaint's layer concept is similar to that 
of Gimp, albeit with only a subset of the 
functionality. 

By default, MyPaint has no dock on 
the right edge, but it is created automati- 
cally once you open a window through 
the buttons arranged on the toolbar on 
the right and “unhook” it from the edge 


INFO 


[1] 
[2] 
[3] 
[4] 


MyPaint: http:/mypaint.intilinux.com 


php/Main_Page 
[5] 
let Set Up 
[6] 
mypaint-1.1.0-released 
[7] 
1-a-guide-through-the-new-features 
[8] 
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(Figure 6). In this window, you can 
change colors, brushes, and layers. 

The brush tips are very special feature 
of MyPaint. The program sorts them into 
various groups, which you can add to 
through subsequent packages. These 
groups combine properties that go be- 
yond the usual form (Table 1). All brush 
tips support Gimp’s “soft drawing” mech- 
anism, which allows you to draw fine 
lines without any noticeable artifacts. 

New to MyPaint 1.1 are the geometry 
tools that you select from Line Mode 
(Figure 5, on the right). With Lines, you 
can draw individual lines; with Line Seq, 
you draw a sequence of lines; and with 
Ellipse, you can create free-hand curves. 
These tools let you make use of pen 
pressure [7], which you can accomplish 
with the Line Pressure setting (Figure 5, 
below). In this same group, you'll find 
the tool for symmetrical drawing. 

As with version 1.0, the newest release 
allows the use of keyboard shortcuts 
(see Table 2 for a summary). Also new is 
the ability to quick-save interim versions 
of your work in what are called “scraps.” 
You can then use F2, F6, and F7 to toggle 
through them. 


CONCLUSION 

Once you complete the somewhat cum- 
bersome installation and configuration 
of the graphics tablet, working with My- 
Paint can be fun. With a few clicks, you 
can set new layers, select brushes, 
switch colors easily, vary the thickness 
of lines, and use various pens. The lay- 
ers feature allows you to trace pictures 
or practice drawing. Overall, the perfor- 
mance is pretty fast and requires few re- 
sources. e 


MyPaint wiki: https:/github.com/mypaint/mypaint/wiki 

Xfce and MyPaint: http:/wiki.mypaint.info/Using_MyPaint_in_Xfce 

Using Wacom graphics tablets: http:/linuxwacom.sourceforge.net/wiki/index. 
Linux Wacom: http:/linuxwacom.sourceforge.net/wiki/index.php/Wacom_Tab- 
MyPaint 1.1.0 announcement: http:/libregraphicsworld.org/blog/entry/ 


New features in MyPaint 1.1: http:/www.davidrevoy.com/article 154/mypaint-1- 


MyPaint manual: http:/wiki.mypaint.info/Documentation/Manual 
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When the news comes at you like a flood, you need a tool to channel the current. RSS readers like 


QuiteRSS can help you sort through the news. 


Organizing and reading RSS feeds easily with QuiteRSS 


OVERSIGHT 


BY FERDINAND THOMMES 


hether it’s celebrity gossip 

or dull facts about the 

economy, the volume of 

news has sharply risen in 
the past few years. Instead of reading 
full articles, many users limit them- 
selves to news feed subscriptions that 
provide a headline and a short sum- 
mary of the news item. 


| Big Money 


re 


4 JU SNOW M 


of Hat 


The bigs 
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This message stream is based on the 
XML format that specialized programs 
(called RSS readers) like QuiteRSS [1] 
present graphically for an easier read 
(Figure 1). The software updates the 
listing with each new posting. (See the 
box “Making Everyday Life Easier” for 
more information.) 

The term RSS reader actually falls 
somewhat short. Apart from RSS, the 
Atom format has become popular over 
the years, so much so that most readers 
also support it. Both formats are based 
on the XML protocol. You can also pull 
several feeds together using the OPML 
format [2]. 


Wine RANGE OF FUNCTIONS 
QuiteRSS is software that runs on a 
local PC. It’s written in C++ and is 
based on the Qt framework that inte- 
grates well on KDE, LXQt, and Unity 
desktops. Its range of functions and 
look-and-feel rivals that of its GTK 
counterpart, Liferea. 

In 2011, Russian developers began 
work on QuiteRSS and the program has 
become part of all major distribution 
repositories. It’s also available for Win- 
dows and MacOS X, making it easy to 
exchange OPML-formatted feed lists 
through exports and imports. Addi- 
tional packages are available for 
FreeBSD and Vern OS/2. Windows also 
has a portable version for USB sticks. 
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In testing, I used a specific PPA with 
Ubuntu 14.10, which installed the cur- 
rent version at the time of writing: 
0.17.7. Work on the software is pro- 
gressing, with a new update about 
every month. 

To install from the PPA, do: | 


© $ Plotter made from scrap computer parts 
© Stream PC games to your TV 


© EN AMD Posts Code for Linux GPU Driver 


anton Park Live Coding Orchestra = The Planets 
© 8 Droplet photography 
2 © cal for Makers is opent Join Maker Faire Rome 2015 
© D Real pirates say Xargs 


© & Visualising core load on the P12 
& Amazonian rainforest simulation 

Arduino web architecture, back to the future 
Raspberry Pi Powered Minion Fart Gun Machine 
Python In Education ~free e-book from O'Reilly 
+ O LibreOffice Tip: To-Do Lists with Style 
© © Let's make robots exploring lake depths 
© E Launching Picademy@Googie Leeds 
© © cata Jasmina with Opendesk @ Milan Design Week 


$ sudo add-apt-repository 2 
ppa:quiterss/quiterss 
$ sudo apt-get update 


$ sudo apt-get install quiterss 
© LA windows Might Go Open Source 
© Di Linux Mint wil stay with Ubuntu 


+ D Krunner~The birth of a cyborg 
= Dy Microsoft Frees Code for NET Build Engine 

© [ Researchers Demonstrate Hack by Heat 

+ O Ubreottice goes Online 

© © Some cool Plasma tips and tricks 

© O Vi Hart, the Mathemusician, explains Net Neutrality 


The program is very thrifty with CPU 
cycles and RAM resources and is, there- 
fore, suitable for older computers, and 
it ran nearly flawlessly during tests | 
over several days. 


# work 
© Per. 

# ToDo 
P ater 


© C New KDES ~ Now with Added intelligence! 
© C Plasma is my new favorite desktop 
© E Kernel Developers Adopt Code of Conflict 


= © Wire Your Arduino Sensors to the Cloud with Temboo Streaming 


30 Percent of New Server Equipment Goes to Cloud infrastructure 


© @ Want to help Ardulno.Cc? Take a pic of your Arduino packages! 


Install intel Galileo & Edison with the IDE Boards Manager 
© © Thanks for Celebrating Arduino Day around the world! 


© © Creative Technologies in the Classroom goes to Ecuador 
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Figure 1: The QuiteRSS interface is similar to that o 
including the news feeds. 


After installation through the distribu- 
tion’s package manager, the interface 
appeared very much like other programs 


f a mail client with a sidebar and an area 


: À i = fmn Ubuntu User 
of the kind, with the setup especially Plaid! we EE TROIS 
. : : > E Quiterss Title 
like a mail client’s. On the left edge are + mogusnes (9) 2 « a PONE vota fat th Best Open source Software for Photos 
me Ubun... (7) ee Linux New Media Awards 2012: Choose Your Favorite Open Source Pr. 


the subscribed feeds, and under that in 
a separate window are Categories in 
which you can organize the news. 

The biggest part of the window on 
the right contains the messages from 
the feeds. In the lower part, you see the | 
full HTML view of the content, thanks 
to the integrated Webkit engine. As 
with many mail clients, you can adjust 
the views to show them horizontally or 


Open Source Forum at CeBIT - Call for Papers 


© = CeBIT Open Source Forum 2012 Videos Now Available 
© am Ubuntu Developer Summit Sponsorships 

Canonical Showcases Linux New Media Pubs 

CFP Ends July 8 


vertically (Figure 2). Pa u i tom tes tnt bo Soy we ete asus 
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# ToDo free 30-day mal yorsion 


P ater 


sage window or viewing it again. How- 
ever, to make optimal use of the soft- 
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Figure 2: The integrated browser with a Webkit ren 
in QuiteRSS. 


ware, it’s a good idea to explore the 
various settings. 


CONFIGURATION 

You can find the options under Tools or 
with F8. Important initial decisions in- 
clude whether to view messages in the 
integrated browser or an external one 


(Figure 3). The latter may be the de- 
fault system browser or any other one 
installed. 

Additional tabs let you set the system 
tray behavior, which usually reports the 


MAKING EVERYDAY LIFE EASIER 


News aggregators are available in many shapes and sizes and for many platforms. 
From among the locally installed applications you can choose those with graphical 
interfaces, such as QuiteRSS, Liferea [3], or the particularly slender Yarssr [4]. 
Among the command-line programs are Newsbeuter [5] or Canto [6], the successor 
to NRSS. If you’d rather go with Java, RSSOw! [7] is a viable alternative. 


Most browsers support RSS readers either in-house or allow you to incorporate 
them later. Also, mail clients like Thunderbird, Evolution, or Sylpheed can show 
feeds. KDE provides the Akregator software in its Kontact suite for this purpose. 
The Internet also has a large number of online readers. 
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dering engine lets you view complete websites 


number of new feeds and gives an audi- 
ble cue (Figure 4). In Feeds | General, 
you can set how often feeds are up- 
dated. In Feeds | Clean Up, you can con- 
figure how long the program retains 
feeds and what policy to follow to do 
the cleanup. 

Other settings affect the program’s 
appearance, such as the color scheme 
and preferred fonts. Another tab lets 
you set keyboard shortcuts. 

On the Browser tab, you can also de- 
activate loading images if you have an 
older computer or a slow Internet con- 
nection. More immediately, you can 
block this content through an icon at 
the lower right corner of the interface. 
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General 


System Tray 
Network Connect... Browser selection: 

© Use embedded browser 
Feeds x 
Labels Use external browser 


Notifications External browser: 


Passwords 
Language © Default external browser 
Fonts & Colors Following external browser: 


Keyboard Shortcuts 


Content: 
@ Load images 
@ Enable Javascript 
@ Enable plug-ins 
Default zoom on pages: | 100% : 


User style sheet: 


General | History Privacy Click to Flash Downloads 


f Create New 


Brow: 


Username: 


Pas: 


Cancel 


| Æ Use title of the feed as displayed name 


C Server requires authentication: 


Feed 


Feed URL or website address: 


Cancel 


{Finish | | 


Figure 3: You can decide whether to send the links to the actual web- 


sites with some other software. 


Next to that is an indicator to show 
whether Adblocker is enabled - a 
unique feature of QuiteRSS. You can 
also disable this for individual web- 
pages without needing to go into the 
browser. 


Easy T0 USE 

After you’ve configured the software to 
your wishes, the next step is to popu- 
late the addresses of the feeds to moni- 
tor. First, you’ll want to clarify whether 
incoming feeds should be stored in 
folders, which is often the best solution 
for larger collections. 

Using the check mark icon next to 
the plus sign in the toolbar in the upper 
left, you can create folders for created 
feeds. Adding a new feed means enter- 
ing the URL of its website and the pro- 


corresponding URL. 


from the link to the feed. If you have 
already worked with another RSS 
reader (e.g., a standalone one, on the 
Internet, or as part of another pro- 
gram), you should check whether the 
program has a data export function to 
save the feeds in OPML format. This 
will allow you to import your feeds to 
QuiteRSS. 

In tests, the program took on about 
400 feeds in a matter of seconds with- 
out a complaint and updated them in 
less than 30 seconds. Even 10 times 
that many caused no problems. How- 
ever, such large amounts can cause 
problems elsewhere, such as for human 
cognitive faculties. With a few options, 
you can reduce the amount of new 


Figure 5: Creating a feed entry is as simple as giving it a name and its 


messages that accumulate over time 
(Figure 6). 


Point oF View 

The software provides two views for dis- 
playing content that you can toggle be- 
tween the using View | Layout from the 
menus. The classic view used by default 
shows only headlines, whereas the so- 
called Newspaper view presents a short 
teaser after the headline to give you a 
better clue of the content of the article it 
links to. The best choice will depend on 
your personal taste or work habits. 

The program allows opening individ- 
ual news, folders, and categories in tabs, 
which facilitates navigation significantly 
if you’re working with many feeds and 


= [ese Ubuntu User News | 
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(Figure 5) 3 Export Feeds... F ~ we Poll: Vote for the Best Open Source Software for Photographers web 
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: A 1 © «s Open Source Forum at CeBIT - Call for Papers wel 
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Figure 4: New messages appear as notifica- 


tions when QuiteRSS is in the system tray. Figure 6: If the flood of information gets out of control, a few options can reduce it. 
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er wig 14 
digital newsstand! = 


MR 


Only a swipe away! 


Download our convenient 
digital editions for your iPad, 
iPhone, or Android device. 


GOOGLE PLAY MAGAZINES 


(UK AND AUSTRALIA) 
ADMIN Magazine Linux Magazine Ubuntu User Raspberry Pi Geek 
BUNTY fospber pif 
EE > 


APPLE NEWSSTAND 
Ubuntu User Raspberry Pi Geek 


py BUNTY 


. 
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Visit our apps page for more information: www.medialinx-shop.com/apps 


Filter name: | Magazines 


| Match all conditions = 


| 
| 


Title + 


contains = 


Perform these actions: 


Mark News as Read < 


Figure 7: Filters organize news with specific conte 


want to store them for future use with- 
out interrupting your workflow. To send 
feeds to specific folders automatically, 
use the appropriate filters (Figure 7). 

You can use built-in functions to sub- 
mit especially interesting news directly 
to the appropriate social network chan- 
nels or through traditional communica- 
tion mechanisms, such as email (Figure 
8). And, if the existing labels aren’t 
enough, you can create unlimited new 
ones or edit existing ones to channel the 
message flow. 


Dynamic OPML 


QuiteRSS is currently unable to load 
OPML collections directly off the web or 


| 
| ‘Suggested CFP topics inci 
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environments, security for systems 


Figure 8: Use built-in functions to redirect news to social networks to gain recognition. 
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Cancel 


nt automatically into categories. 


read them from a local file without re- 
working them, Sites such as Feedshare 
[8] and the “OPML Reading Lists” initia- 
tive [9] allow sharing of your own files 
or those of others, sorting them by sub- 
ject, and downloading them. 

Comparing these files with those cre- 
ated by QuiteRSS showed that the format 
was defined in the web files, but the 
XML specification was missing. How- 
ever, if QuiteRSS refuses to load the file, 
you can easily make up for this by add- 
ing the line 


<¢xml version="1.0" encoding="UTF-8"2> 


at the beginning. 
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PrintFriendly 
See the Cali for Parteipaton page for additional = 


QuiteRSS cannot yet deal with dy- 
namic lists [10] based on OPML, such as 
the web-based Inoreader [11]. If you im- 
port such a list from the web, the list ele- 
ments are static from that point on. With 
dynamic OPML, the lists would normally 
be updated with any new entries the au- 
thor makes, if that’s what you want. 


CONCLUSION 

This GPLv3 software is characterized by 
its clear user interface and largely self- 
explanatory operating concept. The lat- 
ter especially makes it easier for begin- 
ners to enter the world of feed readers, 
but the program also provides enough 
ease-of-use and diversity for RSS profes- 
sionals with a large selection of chan- 
nels and well-defined workflow. The in- 
tegrated browser loads websites 
quickly. 

If you’re looking for an RSS reader or 
miss Google Reader, QuiteRSS is a com- 
pelling alternative. The name originated 
from one of the developers who wanted 
the program to run “quite fast” - some- 
thing they have accomplished in a quite 
impressive Way. e 


INFO 


[1] QuiteRSS: https:/quiterss.org/en/ 
about 


OPML: http:/en.wikipedia.org/ 
wiki/OPML 


Liferea: http://Izone.de/liferea/ 


Yarssr: http://yarssr.sourceforge. 
net 
“Read RSS Feeds in the Terminal 
with Newsbeuter” by Dmitri 
Popov: http://www. 
linux-magazine.com/Online/ 
Blogs/Productivity-Sauce/Read-R 
SS-Feeds-in-the-Termi- 
nal-with-Newsbeuter/ 
%28language%29/eng-US 
Canto: http:/codezen.org/ 
canto-ng/ 
RSSOw/!: http://www. rssowl.org 
Feedshare: http:/feedshare.net 
OPML Readers: http://bit.ly/ 
OPML-reading-lists-web 
[10] Dynamic OPML: http:// 
cleverclogs.org/2014/05/rss-reade 
r-inoreader-to-support-dynam- 
ic-opml-subscriptions.html 
[11] Inoreader: https:/www.inoreader. 
com 
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Installing Ubuntu 15.04......... 
Network and Updates ........... 88 
Package Management.......... 
MURAL 


Ubuntu 15.04 offers nearly no changes 
to the installation process. But, just in 
case you are new to Ubuntu, we'll walk 
you through upgrading or installing the 
latest release. 


f you’ve installed Ubuntu in the 

past, you might notice that, unlike 

its predecessors up to 12.04, 

Ubuntu 15.04 does not fit on one 
CD. As of 12.10 onwards, developers 
also improved the installer, which now 
provides full encryption and Logical 
Volume Manager (LVM). The step in 
13.10 that allowed access to or set up 
of an UbuntuOne account was removed 
in 14.04. Other than these updates, not 
much has changed with the Ubuntu in- 
stallation process. 

Installing Ubuntu 15.04 on your 
computer or virtual machine can be 
done in several ways. Although 
Ubuntu is geared toward novice Linux 
users, installing the system is different 


superuser) 


Welcome 


Español 
Esperanto 
Euskara 
Français 
Gaellge 
Galego 
Hrvatski 
Íslenska 
Italiano 
Kurdi Try Ubuntu 
Latviski a 
Lietuvigkal 
Magyar 
Nederlands 
Norsk bokmal 
Norsk nynorsk 
Polski 
Dartinuae 


shouldn't take too long. 


Youmay wish to read the release notes 


Installing Ubuntu 15.04 


INSTALLATION 
PARTY —— 


from a Windows installation. We’ll ex- 
plain your options and walk you 
through the steps. 


Wuat's New, Vivin? 

If you’re running Ubuntu 14.10, you 
can update to version 15.04 directly. 
However, if you’re upgrading from a 
version of Ubuntu earlier than 14.10, 
you will have to update in steps to 
14.10 first and then to 15.04. 

If you decide to go with a clean in- 
stall, try the Live version first to test 
the programs and get used to the Unity 
desktop. Then, you can load the distri- 
bution via the integrated installer on 
your computer. Regardless of what you 
decide, do back up all your important 


Install Ubuntu 


You can try Ubuntu without making any changes to your computer, directly from this CD. 


Or if you're ready, youcan install Ubuntu alongside (or instead of) your current operating system. This 


Figure 1: Choose Try Ubuntu to run a Live instance on your computer without installing anything. 


84 ISSUE 25 


files first so nothing gets lost in the 
process. 


INSERT MEDIA 

The double-sided DVD that comes with 
this issue provides two versions of 
Ubuntu: one for 32-bit and another for 
64-bit computers. To boot from the 
DVD, first have your computer recog- 
nize it as bootable. Often computers 
do this automatically; starting the PC 
with a bootable CD or DVD in the 
drive invokes the corresponding boot- 
loader. If the computer can’t find the 
DVD, change the boot order via the 
BIOS. 

To get to the BIOS, start up the com- 
puter and immediately press Esc, Del, 
F2, or F12, depending on your com- 
puter. Then, look for the appropriate 
option to change the boot order and 
move the CD/DVD drive to the top of 
the list. If you’re starting Ubuntu from 
a USB stick, move the USB device to 
the top of the boot order. In both 
cases, save the setting and restart the 
computer. 

If your computer is missing a drive, 
use a USB stick. We will assume that 
you already have Ubuntu installed. 
Create the stick by downloading the 
ISO image for Ubuntu 15.04 for the 32- 
bit or 64-bit architecture [1] that your 
installed Ubuntu uses, then load it to 
the USB stick using the Startup Disk 
Creator app in Ubuntu (Figure 2). 

First, delete all previous files on the 
stick, leaving at least 4GB of free 
space. At the top of the Make Startup 
Disk window select the downloaded 
ISO image and at the bottom select the 
USB device to use, then click Make 
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Make Startup Disk 


To try or install ubuntu from a removable disk, it needs to be set up as a startup disk, 


TSIM Source disc image (iso) or CD: 


CD-Drive/Image 


Disk to use: 


Device Label 


OS Version 


Other... 


Capacity Free Space 


) VBOX CD-ROM (/dev/sr0) VBOX CD-ROM 1.16B 


Erase Disk 


When starting up from this disk, documents and settings will be: 


© Stored inreserved extra space 
How much: { 


Discarded on shutdown, unless you save them elsewhere 


Close Make Startup Disk 


Figure 2: The Startup Disk Creator in Ubuntu 14.10 copies the Ubuntu 15.04 image onto a USB stick 
with the required free space. Both Ubuntu versions have to use the same 32-bit or 64-bit architecture. 


Startup Disk. Booting from the USB 
stick requires the BIOS setting previ- 
ously mentioned. 


To do a new installation, insert the 
DVD included in this issue into the 
drive with the DVD with the label fac- 
ing up for 64-bit architecture and fac- 
ing down for 32-bit architecture, and 
then turn off the computer. Then, turn 
it back on and immediately hold down 
the Shift key, and you will get to the 
Ubuntu boot menu. Here you can make 
a language selection using the F keys 
to set language, keymap, and boot pa- 
rameters. 

Press F6 (Other Options) on the 
Ubuntu boot menu so that you do not 


Figure 3: If booting doesn't work, you can adjust boot option in the Ubuntu 


boot menu. 


land on the Ubuntu desktop. The win- 
dow has a Boot Options line at the bot- 
tom (Figure 3). Enter the boot options 
mentioned here instead of the default 

ones quiet splash. 

The nomodest, radeon.modeset, 
nvidia.modeset = 0 or nouveau. mode- 
set = 0 options help if you have graph- 
ics problems and the screen stays 
black. The acpi=off boot option fixes 
power management problems on older 
computers. 


ON Al 
If you do not want to Install Ubuntu 
right away, you can Try Ubuntu with- 
out installing. In Live mode, Ubuntu 
copies only the necessary programs 
into memory and executes them from 


Preparing to install Ubuntu 


Harb Drives IN UBUNTU 


Ubuntu names device files on hard 
drives according to a particular 
schema: /dev/sda is the first detected 
hard drive, with /dev/sda7 its primary 
partition (/dev/sda2 through /dev/sda4 
are the three other primary partitions). 
The /dev/sda5 device is the first logical 
partition located in the (/dev/sda2 ex- 
tended partition. Windows should al- 
ways be located in the first primary 
partition (/dev/sda1), and generally 
also in /dev/sda2. If you plug a USB 
stick or external hard drive in the USB 
slot, these external storage devices 
are listed as /dev/sdb, with everything 
else following the same schema. 
Using the sudo fdisk -l command, you 
can get an overview of the available 
hard disk and USB memory and the 
partitions and filesystems within 
them. 


there. Booting takes noticeably longer 
than with the installed version, and 
the system as a whole is a bit slower, 
but you can test Ubuntu 15.04 with lit- 
tle risk. Also, look at the bundled ap- 
plications to see whether Ubuntu sup- 
ports your hardware (printers, scan- 
ners, wireless, and graphics cards). 

Ubuntu 15.04 loads only the 3D ver- 
sion of the Unity desktop and uses LL- 
VMpipe for slower machines, creating 
sluggish responses on some older com- 
puters (cause for a recommended 
desktop replacement). 


The Ubuntu installer opens in a win- 
dow as shown in Figure 4. First, 
choose a language. The next window 


For best results, please ensure that this computer: 


fl hasatie Bavallable drivespace 


of plugged intoa power source 
tothe internet 
es wile installing 

rd party software to; 

noapic 

nolapic 

edd=on 

nodmnaid 

nomodeset 

Free software only 


Figure 4: The installer provides options, among other things, to prepare for 


MP3 support and for downloading updates. 
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DISCOVERY GUIDE 


Winpows AND UBUNTU 


Windows likes to save its files across the entire hard disk. By defragging the Win- 
dows partition, you arrange the scattered file fragments in a contiguous region. You 
can then shrink the partition without destroying any installed programs. In Win- 
dows 7, you can start the defragging with Start| Programs | Accessories | System 
Tools. In Windows 8, use the search option to look for the defrag program. If you 
freshly installed Windows, a program called chkdisk routinely looks for damages to 
the partition, and then Windows can boot normally. 


After defragging, you can begin shrinking the Windows partition. At the bottom of 
the Start menu, type hard and click Create and format hard drive partition. Window 
XP and Vista have similar functions. 


Next, select the Windows partition you want to shrink. Right-click and choose 
Shrink Volume, enter a desired value in the Total size after shrink in MB field and 
click Shrink, and restart Windows. 


In any case, after you install Ubuntu and restart Windows, Windows resorts to 
chkdiskto check for possible damages. The system then restarts the computer 
again before starting up normally. Wubi [2], the tool to install Ubuntu on Windows, 
is included with Ubuntu 15.04, and you will be able to use it up to Windows 7. Wubi 
only works with Windows 8 if the machine uses the old BIOS firmware and the hy- 
brid sleep option is disabled. 

Installing Windows after Ubuntu is so complicated that we don’t recommend you 
do it. But, if you do plan to do so, choose creating a manual partition in the Ubuntu 


installer (as described in the “DIY Ubuntu” box) while reserving an empty /dev/ 


sda1 partition for Windows. 


checks whether your computer meets 
the installation requirements, which is 
at least 5.9GB available drive space, 
plugged in (important for laptop and 
netbook installations), and preferably 
connected to the Internet. 

In this window, you can set two 
check marks. If you mark Download 
updates while installing, Ubuntu uses 
the idle time during installation to 
download patches and security up- 
dates from the Internet, but doesn’t in- 
stall them yet. 

Checking Install this third-party soft- 
ware loads during Ubuntu installation 


programs documents. photos, muni and any ether Hen m al operating te 


Installation for security 


Figure 5: Choose to erase the entire disk for the Ubuntu install, or make a 


different selection. 
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a few important codecs and plugins for 
your system. These codecs and plugins 
will allow you to play MP3 files on 
your player and see flash content in 
your browser. 

These two options can always be set 
later, so, for now, Next takes you to 
the next window. 

If a wired connection exists to the 
network and Ubuntu recognizes your 
wireless card, the next window dis- 
plays the discovered access points. 
Using the correct password, you can 
connect to the access point. If no 
choices are available, there may be a 


Choose a security key 


up. 


Choose a security key: 
Confirm the security key: 


Warning youlose 
Tor more security: E Ove 


ecuritykey,al 


install Now 


Disk encryption protects your files In case you lose your computer. requires youto enter a security key each 


Any les outside of Ubuntu will nat be encrypted. 


Le empty dik space 


The installation may take much longer 


problem with your wireless hardware. 
For now, you can use a wired connec- 
tion instead. 


CHOICES, CHOICES 

A new window then appears that was 
introduced in Ubuntu 12.10. If Ubuntu 
doesn’t find another operating system 
installed, it provides the options, as be- 
fore, to Erase disk and install Ubuntu 
or to do Something else (Figure 5). 

As of 12.10, there are two additional 
options: Encrypt the new Ubuntu in- 
stallation for security and Use LVM 
with the new Ubuntu installation. If 
you encrypt Ubuntu, the performance 
is a bit less than optimal, although it 
secures data against theft. Note that 
you can always encrypt your home di- 
rectory later. 

If you have another resident operat- 
ing system, such as Windows 8, the 
option Install Ubuntu alongside Win- 
dows 8 appears on the screen, which 
you can invoke using Continue. In this 
case, the options for encryption and 
LVM are grayed out and not available. 
If you have an older Ubuntu version, 
additional options appear in the in- 
staller window. 


Usuntu FLYING SoLo 

Installing Ubuntu by itself takes up the 
entire hard disk and writes all files 
into the /dev/sdal primary partition. 
Also, the Ubuntu install creates the / 
dev/sda2 extended partition and, 
within it, the /dev/sdas logical parti- 
tion that houses the swap area (see the 
“Hard Drives in Ubuntu” box). The 
swap area includes the swap file that 
takes over when working memory is 
overloaded, although writing to the 


e Co pamaré 
o + 


lost. i you need to, write down your key and keep It ina sate place elsewhere 


Figure 6: If you use the complete encryption that Ubuntu provides as an 
option, be sure to use a secure password (security key) and keep it in a safe 
place so as not to lose it. 
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swap area is noticeably slower than di- 
rect access to main memory. 


UBUNTU NEIGHBORS 

Windows often takes up the entire 
hard drive instead. If you want to in- 
stall Ubuntu alongside Windows, you 
must shrink the Windows partition 
and completely defrag it, as described 
in the “Windows and Ubuntu” box. 
Ubuntu 15.04 then invokes the GRUB 2 
bootloader, which boots both systems 
and can handle new computers sup- 
porting secure boot. 


INSTALL Now 

If you opted for self-partitioning, click 
Install Now. To set up complete encryp- 
tion, Ubuntu asks for a security key. Se- 
lect the most secure one possible (Fig- 
ure 6). Ubuntu then asks about your lo- 


REVIVAL 


cation (Where are you?, to get the time 
zone), Keyboard layout, name, user- 
name, and password (Who are you?). 
The latter dialog also asks whether you 
want to Require my password to log in 
or Log in automatically, with an addi- 
tional option to Encrypt my home 
folder. Ubuntu uses EcryptFS for this. 

The following screens are for select- 
ing your timezone, keyboard and set- 
ting your username and password. 

If you have a supported Ubuntu web- 
cams, the installer suggests that you 
take an image of yourself to comple- 
ment your profile. Ubuntu 15.04 can 
also import profiles from other installed 
operating systems, including not only 
browser and email files but also screen 
backgrounds and documents. 

During the install process, you can 
view a slideshow that presents the new 

features in 
Ubuntu. Installa- 
tion can take a 


To revive an installed Ubuntu, boot up Live mode on the 
DVD in this issue by choosing the Try Ubuntu without in- 
stalling option. Be sure that the Live and installed ver- 
sions are the same architecture. Then, invoke a terminal 
and execute the following commands. Substitute for /dev/ 
sda6 entry the specific partition in which the root direc- 
tory (/ of the installed Ubuntu is located. 


sudo mount /dev/sda6 /mnt 

sudo mount -o bind /dev /mnt/dev 
sudo mount -o bind /sys /mnt/sys 
sudo mount -t proc /proc /mnt/proc 
sudo chroot /mnt 

grub-mkconfig -o /boot/grub/grub.cfg 
update-grub2 

grub-install /dev/sda 

exit 


sudo reboot 


Use the chroot command (change root) to mount the in- 
stalled system into your Live system and work with it as if 
you had booted it. Now you can set up a new GRUB 2. 


DIY UBUNTU 


If you want to maintain some control over the installation, 
you can select the Something else option, although this 
process requires some knowledge of the Ubuntu hard 
drive structure (see the “Hard Drives in Ubuntu” box). Ide- 
ally, you would place at least two logical partitions for 
Ubuntu on an empty hard drive: a swap partition (/dev/ 
sda5) and a partition for the root directory that is at least 
4.9GB (/dev/sda6). 


Optionally, add an extra partition for the /home directory 
(/dev/sda7) that gives you enough space for all your files. 
This partitioning has the advantage that you can install 
Ubuntu again later without losing your user data. Add the 
new partitions using Add. For the /and /home directories, 
selecting the Ext4 filesystem is best. 
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while, depending 
on your system, 
and it ends with a 
prompt to Restart 
Now. Remove the 
CD/DVD and press 
Enter so that the 
computer reboots. 
If you activated 
system encryp- 
tion, enter the 
password before 
booting up. 


UPDATING 
UBUNTU 

If you have 
Ubuntu 14.04 in- 
stalled, first con- 
sider whether you 


Install 


Welcome to Ubuntu 


want to upgrade at all. Version 14.04 is 
a LTS version, so it will still be sup- 
ported until 2019. If you have an ear- 
lier version of Ubuntu, you will have 
to upgrade to the intermediate ver- 
sions first. Before beginning, turning 
off the external repositories and PPAs 
makes sense. Use the Software Center 
Edit | Software Sources function and 
remove the checkmarks on the Other 
Software tab. 

Next press Alt+F2 and enter up- 
date-manager -d. In the empty window 
of the update manager, an Upgrade 
button shows at the top. During the 
upgrade, the installer asks whether 
you want to keep or replace a specific 
configuration file; choose to replace if 
you haven’t made any changes. Be- 
cause Ubuntu is downloading many 
packages and replacing them, make 
sure your computer is plugged in to 
stay charged. 


BOOTLOADER FAILURES 

Occasionally, the bootloader doesn’t 
appear after an Ubuntu installation, or 
you can boot only one system. Loading 
Windows after installing Ubuntu often 
leads to a bootloader failure. Refer to 
the “Revival” box for commands you 
will want to enter in a terminal win- 
dow. These commands install the 
GRUB 2 bootloader with help from a 
Live system so that GRUB correctly 
identifies all systems. ə 


INFO 
[1] Download Ubuntu 15.04: http:/ 
releases.ubuntu.com/ivid/ 


[2] WubiGuide: Attps:/wiki.ubuntu. 
com/WubiGuide 


Figure 7: Installation can take a while, but it is painless and can generally be 


left to its own devices. 
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With NetworkManager, you can access 
the Internet during the Ubuntu 
installation process. The first step is to 
download updates to make your system 
more secure. 


Software Updater 


Installing updates... 


Preparing configuration of webbrowserapp 
> Detalls 


Figure 1: If Ubuntu updates are out there, you'll 
find out by invoking the “Software Updater” pro- 
gram. 


Updated software Is available for this 
computer. Do you want to install it now? 


Y Details of updates 
Install 
MA Browser 
E & Cheese webcam Booth 
E iB Contacts 
EA & Document viewer 
OD fies 
EA @ Firefox web Browser 
EA P Font Viewer 
P Technical description 


{© 119.8 MB will be downloaded. 


Settings... 


Figure 2: Ubuntu shows details on what updates 
are waiting in the queue. 
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NetworkManager and system updates 


ACTIVE TRAFFIC 


BY KRISTIAN KISSLING 


fter the official release of a distri- 

bution, the developers continue 

to iron out bugs with various 

patches, and they continue to 
minimize security vulnerabilities during 
the entire support period of the operating 
system. Ubuntu15.04, for example, will be 
supported for the next 9 months. If you 
install the distribution a few weeks after 
its official release, updates are already 
available. 

To look for updates, call up the Software 
Updater program (Figure 1), which dis- 
plays a list of installable patches. Clicking 
Install Now downloads the patches onto 
your computer (Figure 2). Restart the sys- 
tem to apply the patches. If no updates are 
available, you will see The software on this 
computer is up to date (Figure 3). 

Bug fixes help keep your system safe 
and secure. With a few exceptions, such 
as Firefox and Thunderbird, newer ver- 
sions of installed programs are updated 
with the next Ubuntu version. Within the 
support cycle of Ubuntu15.04, only Back- 
ports and PPAs [1] can be applied to a 
new version. Backports are special reposi- 
tories that provide newer versions of some 
software [2]. 


CHICKEN AND EGG 

To get updates for Ubuntu15.04, you must 
have access to the Internet. The Network- 
Manager helps you set up that access dur- 
ing the installation. If you’re not cabled 
in, the installer presents a window listing 
the neighboring wireless networks and 
asks you to connect to one, which is when 
installation begins in earnest. To bypass 
this step, install Ubuntu without Internet 
access, and then later set it up through the 


Software Updater 


@ The software on this computer is up to date. 


Cx) 


Settings... 


Figure 3: No updates are needed and you are 
good to go. 


NetworkManager, which is represented by 
a small icon at the top right of the screen. 
If you're using a wireless card, you will 
see a wave-shaped icon and, if the system 
is connected, the icon reflects the quality 
of the connection. Since Ubuntu 12.10, 
connecting to the Internet even before 
signing onto the desktop is possible. 


WIRELESS PROBLEMS 

Not all wireless cards work flawlessly with 
Ubuntu. Before you install Ubuntu on your 
computer, use the Live version to test 
whether Ubuntu recognizes your wireless 
chip. Boot into Live mode and try to con- 
nect to one of the wireless networks dis- 
played. If connecting fails or no access 
points are showing, check the hardware 
switch on the computer itself. 

If you run into problems configuring 
wireless cards, DSL modems, or UMTS 
sticks because NetworkManager doesn’t 
recognize them, temporarily connecting 
the computer with a network cable to a 
switch or router usually works. 

Hardware is a frequent source of wire- 
less problems. On many notebooks, a but- 
ton turns on the wireless card, whereas on 
others, a special key combination (such as 
Fn+F5) or a single F keystroke works. Test 
to see whether the WLAN has been deacti- 
vated by mistake. To enable access for DSL, 
UMTS, and so on, click in the upper right 
on the NetworkManager icon and choose 
Edit connections. Through Connection in- 
formation, you can find out whether the 
access point provided you an address via 
DHCP (Figure 4). DHCP (Dynamic Host 
Configuration Protocol) is the service that 
automatically assigns you an IP address in 
the local net. Most routers provide DHCP 
addresses by default. 


ETHERNET 

Wireless routers usually have inputs for 
network cables. If the router assigns IP ad- 
dresses with DHCP, which it usually does, 
NetworkManager automatically connects 
after you plug in the network cable. Rarely 
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Connection Information 


(i) Active Network Connections 
WLAN_68 (default) 


General 

Interface: 802.11 WiFi (wlano) 
Hardware Address: 00:13:02:B0:BA:26 
Driver: 

Speed: 54 Mb/s 

Security: WEP 


IPv4 

IP Address: 192.168.1.38 
Broadcast Address: 192.168.1.255 
Subnet Mask: 255.255.255.0 
Default Route: 192.168.1.1 
Primary DNS: 80.58.61.250 
Secondary DNS: 80.58,61.254 


1Pv6 


Close 


Figure 4: Connection Information provides some 
helpful connectivity facts. 


does this not work, but if that is the case, 
you must assign an IP address and domain 
name manually. 


WIRELESS NETWORKS 

So that Ubuntu can set up your wireless 
card properly, the kernel needs to find a 
suitable driver for the card. Then, it’s as 
easy as clicking the NetworkManager to 
obtain the neighboring networks (Figure 
5). Select the name of the wireless net- 
work and log in with your passcode. To 
avoid mistyping the password, make the 
password visible. Ubuntu automatically 
detects the encryption type (WEP or WPA) 
the access point uses. After a successful 
network authentication, your wireless 
card provides you a valid IP address via 
DHCP. 

Setting up your smartphone (Android or 
iPhone) as an access point, which is called 
tethering, also works. NetworkManager 
treats the tethered smartphone as a normal 
access point and connects to it. Smart- 
phones use the Universal Mobile Telecom- 
munications System (UMTS) to get to the 
Internet, which is a good solution when 
you are on the move. Don’t forget, how- 
ever, to secure the access point on your 
mobile phone with a good password and 
deactivate it when you are done. 

If the kernel doesn’t provide a driver for 
your wireless card, a proprietary driver is 
usually available. To test this, press the 
Windows key and open the Software Repos- 
itories program. If the Additional Drivers 
tab lists the driver for your card, click Acti- 
vate so that the wizard can download the 
corresponding software for the card. 

If both steps don’t work, search online 
for Ubuntu15.04 {YOUR WIRELESS CHIP}. 


À WLAN_68 


Disconnect 


à Airport_ 
CamposAbogados 
FB7270 
FISCAL 
MOVISTAR_17CB 


More networks 


Connect to Hidden Wi-Fi Network... 


Create New Wi-Fi Network... 
VPN Connections 


v Enable Ne 
v Enable Wi 


rking 


Connection Information 

Edit Connections... 
Figure 5: NetworkManager displays the neigh- 
boring access points, which is generally the first 
choice when accessing the Internet.. 


To find out what your built-in wireless chip 
is called, press Ctrl+Alt+T to open a termi- 
nal and enter: 


$ Ispci | grep "Network" 


For a USB device, use the following com- 
mand to find the chip’s ID number: 


$ lsusb 


An Ubuntu help page [3] lists the wireless 
card and its degree of support in Ubuntu 
and its derivatives. Setting up an unsup- 
ported wireless cards can be complicated 
on occasion, and other times a simple shell 
command can activate a card. In some situ- 
ations, programs such as Ndiswrapper 
allow use of the card’s Windows driver 
with Ubuntu [4]. 


UMTS Carbs AND DSL Mopems 
Using NetworkManager, you can also set 
up UMTS cards and chips, as well as DSL 
modems. Of course, the system must recog- 
nize the hardware; otherwise, the tabs are 
grayed out. Once Ubuntu identifies a UMTS 
card, insert the card into the USB slot, 
enter the PIN, and configure it using Net- 
workManager. 

DSL modems are also candidates for 
NetworkManager. Click Edit Connections 
and choose Add on the DSL tab, connect 
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the DSL modem to the phone jack and 
your computer via cable to the modem, 
and apply the access credentials from your 
Internet service provider. These will go on 
the DSL dialog. 

Usually you will find a long line of text 
among the data, including the @ character. 
The part before the @ is your username, 
and the part after it is the service name. 
Then enter the passcode and change to the 
Wired tab, where you enter the MAC ad- 
dress of your network card connected to 
your DSL modem. The name is usually 
ethO. After you determine the address, 
open a terminal and enter: 


$ /sbin/ifconfig | grep Hardware 


The MAC address consists of six two-char- 
acter sections separated by colons. Enter 
the MAC address in the field for the DSL 
configuration. 


VPN Connections 

If you want to surf securely on the Internet 
through a tunnel, use a virtual private net- 
work (VPN) solution such as OpenVPN, 
which NetworkManager also supports. De- 
tails on OpenVPN and how it works with 
Ubuntu are in an article in Ubuntu User 
issue 13, page 58-59. 


TROUBLESHOOTING 

If the DSL or UMTS modem is still giving 
you problems despite the correct driver, 
NetworkManager may have a bug. One so- 
lution is to install a recent version of the 
software by integrating a PPA. This pack- 
age often provides a newer version than 
the one normally used by Ubuntu. Often 
you can solve network problems by im- 
porting all updates for your release and re- 
starting the computer. e 


INFO 


[1] Packaging/PPA: https:/help. 
launchpad.net/Packaging/PPA 

[2] UbuntuBackports: https:/help. 
ubuntu.com/community/ 
UbuntuBackports 

[3] WifiDocs/WirelessCardsSup- 
ported: https:/help.ubuntu.com/ 
community/WifiDocs/ 
WirelessCardsSupported 

[4] WifiDocs/Driver/Ndiswrapper: 
https://help.ubuntu.com/ 
community/WifiDocs/Driver/ 
Ndiswrapper 

[5] Using OpenVPN Under Ubuntu: 
http:/www.ubuntu-user.com/ 
Magazine/Archive/2012/13/ 
Using-OpenVPN-Under-Ubuntu 
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Ubuntu Software Center lets you 
install just about anything, including 
free software, purchased apps, and 
games. 


Our star apps 


Figure 1: Software Center encourages you to 
browse. 


buntu includes the convenient Soft- 

ware Center, which provides central- 

ized software management and al- 

lows you to search for new software 
and install it with a mouse click. With an 
Ubuntu One account, you can purchase soft- 
ware with a credit card. 

The Debian packages (that end in .deb) that 
Software Center offers are actually archive 
files containing libraries, configuration files, 
and executable programs. If you install the 
Firefox package, for example, the package 
manager distributes the necessary files to the 
correct places in the filesystem for you. Often 
there are dependencies, which means that in- 
stalling program A requires that you have pro- 
gram B also installed. 

The package manager identifies the depen- 
dent packages automatically during installa- 
tion and loads them onto your computer. Usu- 
ally, you will notice the dependencies when 
you try to install a single Debian package over 
the Internet. The package you are looking for, 
such as a video codec, may be missing in the 
Software Center. In this case, you can find the 
package in external repositories created by the 
software’s users or developers. The reposito- 
Ties contain the software as well as the pack- 
ages on which they depend. (See the “What 
Are Repositories?” section.) 


PACKAGE MANAGER IN ACTION 

Getting to repositories 
and installing soft- 
ware is often faster 
from the command 
line. The “Quick 
sources” section goes 
into greater detail. 
First, let's look at 


etat t (EES 
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managing packages 
using Ubuntu’s Soft- 
ware Center. To ac- 
cess the Software 
Center, press the 


Figure 2: Clicking a category on the left opens up other subcategories. 
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Super key [1] and en- 
tering softw. The start 
page (Figure 1) fea- 


BY KRISTIAN KISSLING 


tures a few What’s New and Top Rated applica- 
tions. Clicking More on the far right gives you 
additional choices. 

If you click Turn On Recommendations at the 
bottom, Ubuntu suggests opening a user ac- 
count at Ubuntu One. Then your computer reg- 
ularly sends lists of software you've installed to 
Canonical and the company returns a list of rec- 
ommended software that might interest you. 
These recommendations appear on the start 
page and can be deactivated with View | Turn 
Off Recommendations in the global menu. In 
the meantime, you can purchase programs 
using your Ubuntu One account. 

Use the arrow icons in the upper left to return 
to the start window. Starting with the release of 
Ubuntu 12.10, Ubuntu developers have placed 
ads for free and commercial software from the 
Software Center across the broad surface of the 
screen under the heading Our Favorites. 

The left side of the Software Center screen 
organizes the applications by category. Click- 
ing a category opens subcategories (Figure 2). 
All other controls are at the top of the package 
management window. The All Software menu 
lists all the software in all the available reposi- 
tories. If you click the little white triangle next 
to the menu item (Figure 3), you'll find the 
entries Provided by Ubuntu (mostly free soft- 
ware), Canonical Partners (free and commer- 
cial software without source code, such as 
Skype and Flash), and For Purchase (commer- 
cial software, including many games). 

Clicking Installed on the menu bar at the top 
displays only the installed applications, sorted 
by category. Click the little triangle to the right 
to view the packages from a single source. At 
the far right is the History menu item that tells 
you which software you downloaded. Check 
here if an upgrade suddenly isn’t working. 
Downgrading, unfortunately, doesn’t work in 
Software Center. To do that, you must install 
the Synaptic Package Manager and specify an 
earlier Version in the Properties. 

If you already know the name of the soft- 
ware, search for it in the search field at the 
upper right. Results come from the repository 
that you use for All Applications. Next to the 
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Access What's New More 


Books & Magazines P.S. Notes. 


Accessories 


Tiny Puzzle Garden 
Puzzles 


Developer Tools 


Education 


| Fonts || DET] Ubuntu User Issue 14 
| Games TEE Books & Magazines 


Graphics US$ 15.99 


The Odyssey HD 
Role- Seku 


Internet 


{il Auto Mouse Click Booster 
Office | Universal Access Internet 
$ ERRER (5) 


Science & Engineering US$ 10.00 


Sound & Video 


| Mini Minecraft Launcher 
ae Games 
Themes & Tweaks a) 


Universal Access 


TubeMixing 
Sound & video 


Figure 3: Clicking the little white arrow next to “All Software” shows you the reposito- 
ries available. 


software names are the ratings in the form of stars. Once you select a package, 
the More Info and Install buttons appear. The first button leads to a detailed de- 
scription of the program, often showing a screenshot (Figure 4). 


Ubuntu Software Center A 


es Texmaker 

LaTex Are environment 
FH IK (45 cating: 

his 


Free Install 


Texmakeris a clean, highly configurable LaTex 
editor with good hot key support and extensive 
LaTeX documentation. Texmaker integrates many 
tools needed to develop documents with LaTeX In 
just one application. It has some nice Features such 
as syntax highlighting, insertion of 370 
mathematical symbols with only one click, and 
"structure view" of the document for easier 
navigation. 


Devel 


Version texmaker 3.4-1 
Total size 614.6 MB to download, 938.2 MB when installed 
License Opensource 


Updates Canonical does not provide updates For Texmaker. Some updates may be provided by 
the Ubuntu community 


Reviews English * Most helpful first + 


Figure 4: Once you choose an installable package, you'll get further information on it: 
ratings, screenshots, descriptive text, and more. 
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Look under the Add-ons section to see software that could 
enhance the program. Here People also installed displays 
other programs to consider. You can also filter reviews by 
language is. Finally, click the Install button to install the pro- 
gram. Once installed, you can click the Write your own re- 
view link to evaluate the software. This requires a Launch- 
pad account [1]. 

The search won't find all programs. Software Center hides 
libraries, developer files, and even programs without graphi- 
cal interfaces, such as the mplayer command interface. To 
install these programs, choose Show [some number] techni- 
cal items at the bottom of the window (it is nearly invisible, 
being dark grey on black) or enter the full name of the soft- 
ware in the search field (Figure 5). 

The Software Center global menu includes other interest- 
ing options. In the File menu, you can choose Reinstall Previ- 
ous Purchases or Sync Between Computers to move your 
package selections to other computers over the Ubuntu One 
cloud service. Also, you can use Edit | Software Sources to 
add other repositories. If you don’t want to display new ap- 
plications automatically in the Launcher, unmark the New 
Applications in Launcher checkbox in the View menu. 


WHAT Are Repositories? 

Software Center gives you access to thousands of packages, 
but the one you want may be missing or only in an older 
version. This is where external repositories and the PPAs 
help. The Opera repository [3] is one of the external reposi- 
tories and provides the Opera web browser that is missing 
from Ubuntu’s standard repositories. The VirtualBox project 
[4] also provides the proprietary version of its own software, 
which supports the virtual USB 2.0 ports and Remote Desk- 
top Protocol (RDP), from its own repository. 

Personal Package Archives (PPAs) are special versions of 
external repositories that you can only find on Ubuntu’s 
Launchpad. When experienced Ubuntu users or developers 
create Debian packages out of their favorite software, they 
frequently offer them in their personal package archive on 
Launchpad. Using a search function [5], you can peruse 
the platform for new versions of current software with 
great success. 


COMPLEMENTING PACKAGE SOURCES 

In Software Center, you can download from external reposi- 
tories using Edit | Software Sources. To use the Opera proj- 
ect’s external sources, for example, click Other Software and 
Add, then enter deb http://deb.opera.com/opera/ stable 
non-free. This address wasn’t invented: Usually, the address 
is the website for the external repository. Click the Add 
Source button to accept the repository (Figure 6). 

External repositories often protect themselves from abuse 
with keys. Every package has a signature verified with a key, 
so that manipulated packages with mismatched signatures 
fall by the wayside. Often you can’t access a package offer- 
ing without a key, but how do you find the key? 


Figure 5: Additional libraries, developer files, and programs are 
listed as technical items. 


IssuE25 91 


- DISCOVERY GUIDE = == 


Enter the complete APT line of the repository that you want to 
add as source 


nd components of a repository, for 
neu saucy moi 


APT ine: [deb hitp://deb.opera com/opera/ stable nontred 
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Figure 6: Obtain additional packages from exter- 
nal repositories. 


To import the key for the Opera repository, 
invoke a terminal through Ctrl+Alt+T and 
use the following command: 


$ sudo apt-get update 


The command updates the list of available 
software for Software Center and returns an 
error message. Then, enter the following: 


$ sudo wget -0 - http://deb.opera.com/ 2 
archive.key | sudo apt-key add - 


For other repositories more tied in with 
Ubuntu, you may have to query the Ubuntu 
keyserver: 

$ sudo apt-key adv --recv-keys --keyserver 2 
hkp://keyserver.ubuntu.com:80 B9AQ6DE3 


In this case, the command downloads the ap- 
propriate key (B9AOGDE3) for the developer’s 
Launchpad PPA for the Inkscape vector de- 
sign software and integrates it with package 
management. If you can't get to the key- 
server, it may be temporarily overloaded. Re- 
place keyserver.ubuntu.com in the command 
with another keyserver, such as subkeys.pgp. 
net, pgp.mit.edu, or keys.gnupg.net. After the 
sudo apt-get update command, you should be 
able to install the software from the source. 
The new repository might not show up in 
Software Center right away. 


Key OVER TERMINAL 

As seen above, most websites show a simple 
ine that you can copy with Ctrl+C and 
Ctrl+V to the terminal. The line might appear 
as in the following VirtualBox example: 


$ wget -q http://download.virtualbox.org/ 2 
virtualbox/debian/oracle_vbox.asc -0 - 2 
| sudo apt-key add - 


The command downloads the key from the 
website (using wget -q {HTTP-LINK}), sends 
it to the console (with -O -), and passes it to 
the sudo apt-key add command. Then, use 
sudo apt-get update to update the package list 
and load up the VirtualBox package. 


INTEGRATING PPAS 

With about 6,000 active PPAs on Launchpad, 
it is easy to get brand new software versions 
with the latest functionalities. Among them 
are exotic programs and (unstable) developer 
versions of system components, such as the 
kernel or NetworkManager. Before compiling 
software from the sources, first use a PPA 
search [4] to see whether there might not be a 
PPA for it. 

The fastest way to integrate PPAs into the 
package manager is through the command 
interface because it saves you the key search. 
Press Ctrl+Alt+T to open the terminal and 
enter what usually amounts to three com- 
mand lines, something like the following: 


$ sudo add-apt-repository 2 
ppa: inkscape.dev/stable 

$ sudo apt-get update 

$ sudo apt-get install inkscape 


This happens to mount the PPA for the Ink- 
scape vector drawing solution. For other soft- 
ware, simply replace the parts after ppa: and 
sudo apt-get install. Take the text for the part 
after ppa: from the website (Figure 7). It may 
take a while for the repository to appear in 
Software Center. 


REMOVING SOFTWARE 

To remove software, open Software Center 
again, search for the name of the software, 
and click Remove. The configuration data is 
thereby unaffected. The advantage is that you 
don’t need to reconfigure the software if you 
decide you need it again later. If these rem- 
nants (such as you might find in the /etc or / 
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Figure 7: In this PPA, you'll find the current packages for Vivid Vervet to 


the repositories in 
the background. As 
already noted, you 


can also run apt over the command line; 
many experienced Ubuntu users prefer this 
method because the commands work with 
any Ubuntu derivative. Here are four impor- 
tant commands: 


$ sudo apt-get update 

$ sudo apt-cache search 2 
(--names-only) inkscape 

$ sudo apt-get install inkscape 

$ sudo apt-get remove (--purge) inkscape 


The first command brings the package list 
up to date, an important thing considering 
how quickly program versions change. The 
next line searches for a package whose 
name or description includes the term ink- 
scape. Add the -names-only option (without 
the parentheses) to search for the package 
name only if too many hits are returned. 
The third line installs the package, and the 
fourth line removes it. 

You can use the optional --purge option to 
purge the configuration files in the home di- 
rectory along with the package down to the 
local configuration that you have to remove 
yourself. 

To remove all the packages installed 
through a PPA, either use Software Center 
and choose the PPA next to Installed, or stay 
on the command line, install the ppa-purge 
package, and use the following command 
(for the Inkscape example): 


$ sudo ppa-purge ppa:inkscape/stable 


SINGLE CONSIGNMENTS 

Finally, there are some websites that pro- 
vide single Debian packages to download. 
To install the software, double-click the DEB 
package. Ubuntu then calls Software Center 
and recommends installing the package. 
Once you click OK, the package appears to- 
gether with a screenshot and description in 
Software Center. Finally, download the 
package with Install. e 


INFO 


[1] What are the meta, super, and 
hyper keys? http://askubuntu. 
com/questions/19558/what-are-th 
e-meta-super-and-hyper-keys 


[2] Ubuntu’s Launchpad platform: 
https:/launchpad.net 

[3] Opera repository: http:/deb. 
opera.com/ 

[4] VirtualBox project: http://www. 
virtualbox.org/wiki/Linux_Down- 
loads 

[5] PPAs in Launchpad: https:/ 
launchpad.net/ubuntu/+ppas 
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You can watch movies, play music and 
place calls over the Internet with ease 
with Ubuntu. You just have to load the 
right software packages onto your 
computer. We present some of our 
favorite multimedia apps. 


Multimedia components and proprietary programs 


THATS 


ENTERTAINMENT 


BY TIM SCHURMANN, MARCEL HILZINGER 


laying movies and music, ripping 
DVDs, and making Skype calls - 
that’s all possible with Ubuntu. Al- 
though the Ubuntu installer already 
provides basic “third-party” multimedia 
codecs, these options might not fulfill ev- 
eryone’s wishes. At least, the distribution 
loads the legitimate MP3 codec from Flu- 
endo onto the computer through the 
ubuntu-restricted-addons package, along 
with components for the GStreamer frame- 
work (plugins-ugly, plugins-bad, ffmpeg) 
and a Flash plugin installer from Adobe. 
As a result, you can play MP3 files, burn 
audio CDs, and view more than 90 movie 
formats right after installation. However, 
the installed package is not compliant with 
the ubuntu-restricted-extras package that 
you should install after the installation. It 
provides additional codecs for GStreamer, 
some typical Microsoft fonts (that you need 
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to sign an EULA for first) and the UnRAR 
unpacker, You'll also need to install the 
LAME library so that you can create and 
play MP3 files from audio CDs. 


GSTREAMER 

Generally, numerous programs in Ubuntu 
play music and movies, but there are some 
standard apps. Rhythmbox (Figure 1) is the 
preinstalled app for playing music. You can 
use the software to convert CDs to MP3 
format, although RipperX [1] is much bet- 
ter suited for this. Totem, on the other 
hand, is the default video player. 

This very simple player uses the 
GStreamer format. The drop-down menu 
used to access the videos and podcasts 
from YouTube and the BBC in the past is 
missing in the current version (Figure 2). 
Many users, however, also install VLC, the 
multimedia player that plays everything, 


Display Sener 
ar 


Ovisual Effects 


+= 2 Requesting cove for Music From The OC Mix 
Figure 1: Rhythmbox plays not only MP3s but also radio stations, and it provides integrated music 
shops. Better software exists for converting from audio CDs. 
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MULTIMEDIA APPS 


back: LinDVD from 
Corel [4] and the 
Fluendo DVD 
player [5], whose 
developers also 
participate in 
GStreamer. You can 
find the latter in 
the For Purchase re- 
pository. Until a 
couple of months 
ago, you could turn 
to the Medibuntu 
repository. It used 
to house - apart 


provides more features than Totem, and 
can be extended easily through modules. 
You can find these modules in the Software 
Center if you search for vlc-plugin-. 

Brasero is still used as a CD burner, and 
it provides an integrated cover editor. Al- 
though Brasero does not do Blu-ray record- 
ing, K3B, available in the Software Center, 
does, although it will involve some system 
tweaking. Apart from K3B, you will have to 
install a special PPA, which substitutes 
wodim, the default underlying disk-burn- 
ing software, for cdrecord, a software that 
can handle Blu-ray disks. There are full in- 
structions on how to do this online [2]. 

Running in the background for the previ- 
ously mentioned programs is GStreamer, a 
modular multimedia framework that's 
available to many audio and video apps. 
Many programs don’t need to support spe- 
cial codecs, because GStreamer provides the 
playback capability. To play an MP3 file, 
Rhythmbox hands over the task to 
GStreamer, which rummages through its re- 
sources for a plugin to handle the MP3 for- 
mat. Using the contained codecs, GStreamer 
converts the files into audible material (Fig- 
ure 3). To teach Totem and Rhythmbox new 
data formats, often you can just install a 
matching GStreamer plugin. 


DANGEROUS LIAISONS 
Although you can use these “limited extras” 
for multimedia formats, you can’t watch en- 
crypted DVDs - which covers just about all 
commercial DVDs... Well, you can but you 
have to bypass the Content Scrambling Sys- 
tem (CSS). This requires libdvdcss2, pro- 
vided by the VideoLan [3], but this is con- 
sidered a legal gray area in many countries. 
Use of this software is often banned because 
it cancels the CSS playback protection and is 
therefore considered to violate the “effective 
copy protection mechanism.” 

In some countries, you can resort to two 
commercial Linux programs for legal play- 
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Figure 2: Totem is becoming more and more minimalistic with every version. 
f you need more control over your media, VLC is a better option. 


from MPlayer and 
Mencoder - an- 
other codec pack- 
ages that you needed to play and edit 
movies in all formats. Medibuntu since 
has been closed and all its packages have 
been moved to the main repositories (ex- 
cept for libdvdcss mentioned above). 


PARTNERS AND SHOPPING SOURCES 
Some proprietary applications like Skype 
and VMware View Client aren't offered in 
the Ubuntu’s standard repositories. Al- 
though these programs might be free (as in 


beer), they’re often under proprietary li- 
censes and are not provided with open 
sources. 

These third-party apps can often be 
found in the Canonical Partners repository 
that you must first activate. In Software 
Center, select Edit | Software Sources, click 
the Other Software tab, then activate the 
Canonical Partners entry. Again, it might 
take a while before the sources appear in 
Software Center. 

The For Purchase repository contains 
mainly software that you can purchase 
through Software Center - among which is 
this magazine in various language editions. 
Developers usually release the content of 
these sources on their release date. When 
you select the software and click Purchase, 
Software Center links to the Launchpad 
login page. You can log in to (or register at) 
the Ubuntu One service and pay via credit 
card. Apart from official DVD players, 
you'll also find nifty games such as Family 
Farm (Figure 4), Oil Rush, and World of 
Goo. The same payment plan applies to the 
repository named Independent. There, 
you'll find mainly apps of external devel- 
opers that put some minimal time into 
Ubuntu. Some of them are quite useful, 
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with new codecs. 


Figure 3: Rhythmbox and Totem rely on the GStreamer framework that provides the necessary plugins 


Figure 4: Running under Ubuntu, you'll find not only 1990s-style graphics but also visually appealing 
games, such as Family Farm. 
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however, because they’re meant to handle 
smaller tasks. 


ADOBE PRODUCTS 

Loading the flashplugin-installer package 
on the computer brings in the latest Flash 
versions direct from the Adobe website. 
You might have installed Adobe’s PDF 
Reader from the partner repository in the 
past. However, you will only need it if 
Ubuntu’s Evince built-in PDF viewer has a 
break down opening a file - which does 
happen in rare cases with PDF files with 
3D content or very complicated graphics 
with many levels. For security reasons, you 
should avoid using Adobe Reader. 


SKYPE AND GOOGLE VIDEO 

Even the new version 4 of Skype is in the 
Canonical Partners repository. Apart from 
videotelephony, it also provides desktop 
sharing: To make collaboration easier, 
your conversational partner can peek at 
your desktop. Thanks to the new version, 
the image quality of Skype for Linux is 
gradually matching that of the Windows 
client. Be aware, though, that Skype is one 
of the pieces of software that most spies 
on your communications. If you value 
your privacy, don’t use it. 

As an alternative to Skype, check out 
Google’s Hangout video platform, which 
also allows calls among multiple partici- 
pants (Figure 5). You'll need a Google ac- 
count, so register at the Google website 
and go to the left at the top of the 
Google+ profile. 

In the right-hand column, select Start 
Hangout and install a video plugin for 
your system. You can simply download 
the corresponding DEB package and dou- 
ble-click the file manager. 

Again, Google Hangouts are also sus- 
pect when it comes to user privacy. An ex- 
perimental, but very secure and private al- 
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igure 5: Like Skype, Google Hangout provides video chat capability. 


ternative is Tox [6], a new, free, and open 
protocol that implements peer-to-peer en- 
crypted live communication, including 
audio and video chats. Your best bet is to 
download the Tox client [7]. Then, you 
just have to decompress it, and it is ready 
to use. 


GOOGLE EARTH 

Those who enjoy using Google Earth [8] 
can also install it in Ubuntu 14.10. Just 
download the corresponding Debian pack- 
age for your architecture, then go to Soft- 
ware Center and install the {sb-core pack- 
age. Double-clicking the Google Earth 
package loads it on the computer, which 
can take a while mainly because the pack- 
age grabs additional files from an online 
server. Be sure you have enough free space 
reserved. Then, you can start Google Earth 
by entering goog in the Dash. Be fore- 
warned, however, Google Earth is no fun 
without proper 3D acceleration. 


THE New JAVA 

To use Java applications, you need a Java 
Runtime Environment (JRE). Ubuntu does 
not provide Oracle’s proprietary Java ver- 
sion anymore - only the free OpenJDK. Be- 
cause some Java programs had problems in 
the past with OpenJDK, many users often 
resorted to the proprietary Java (sun-java). 
But, that’s missing now because Oracle put 
it under a nonfree license. Because the pro- 
prietary Java is compatible with OpenJDK 
7 - the official Java reference - most Java 
programs should be able to make do with 
the free Java. 

You can install the software from the 
openjdk-7-jdk and icedtea-7-plugin pack- 
ages, and the older version from openjdk-6- 
jdk and icedtea-6-plugin via the following 
command: 


$ sudo update-alternatives --config java 
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ae ron 


Figure 6: Tox keeps your conversations, even your video chats, private. 


This step activates one of the parallel in- 

stalled Java versions. If an app refuses to 
run, it’s best to submit a bug report at the 
Ubuntu wiki [9]. 


SEEK AND YOU SHALL FIND 

You can install many proprietary apps and 
multimedia codecs from the existing repos- 
itories. Numerous proprietary Windows 
programs also run in the Wine Windows- 
compatible environment [10]. Other than 
that, take a look in the Ubuntu package 
manager, because almost any application 
has a free alternative. e 


INFO 
[1] RipperX: http:/sourceforge.net/ 
projects/ripperx/ 


[2] Recording Blu-Ray disks: Attps:/ 
help.ubuntu.com/community/ 
CdDvd/Burning#Blu-Ray_Burning 

[3] libdvdcss at VideoLan: http:// 
www.videolan.org/developers/ 


libdvdess.html 

[4] LinDVD: http:/en.wikipedia.org/ 
wiki/LinDVD 

[5] Commercial GStreamer plugins: 
http://www.fluendo.com 


[6] “Safe Communication with Tox’, 
by Vineze-Aron Szabo, Ubuntu 
User Issue 24, p. 44: http://www. 
ubuntu-user.com/Magazine/ 
Archive/2015/24/ 
Safe-communication-with-Tox 

[7] ÎŒTox: http:/utox.org/ 


[8] Google Earth: http:/www.google. 
com/earth/index.html 

[9] Reporting bugs: https:/help. 
ubuntu.com/community/ 
ReportingBugs 

[10] Wine: http:/www.winehq.org/ 
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